00000001:02000400:0.0F:1787118474.374043:0:2953:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787118494.536864:0:3174:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787118496.330331:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 591 MB/s 00000001:01000000:3.0:1787118496.581586:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 693 MB/s 00000001:01000000:1.0F:1787118496.830796:0:3234:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4023 MB/s 00000020:02000000:2.0:1787118497.692063:0:3266:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_3_g9f8445d 00000400:02000000:0.0:1787118498.867029:0:3281:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.110@tcp [8/256/0/180] 00008000:02000000:1.0:1787118502.282751:0:3431:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787118554.843957:0:5239:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787118566.025924:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787118566.025930:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787118566.026041:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a9ac10eb 00000080:02000400:0.0:1787118566.026053:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787118566.032207:0:5822:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787118566.032220:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787118566.032285:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fc5f426e) 00000020:00000080:0.0:1787118566.032312:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787118566.058348:0:5822:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787118566.058712:0:5822:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787118566.102230:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787118566.102291:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787118566.102318:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787118566.102368:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787118566.102395:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787118566.102954:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787118566.102962:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787118566.102972:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f822b 00000020:01000004:3.0:1787118566.102979:0:5822:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787118566.102983:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787118566.103055:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a9ac10eb from MGS 00000020:01000004:3.0:1787118566.103059:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787118566.103077:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b2a8ee00) 00000020:00000080:3.0:1787118566.103155:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787118566.103256:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9ac10eb from MGS, refs=2 00080000:01000000:3.0:1787118566.103261:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787118566.103266:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f8239 00000100:00100000:3.0:1787118566.103358:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787118566.103494:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787118566.103500:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787118566.104293:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787118566.104301:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787118566.105404:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118566.105590:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787118566.105596:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787118566.106471:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787118566.106490:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787118566.107073:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787118566.107152:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787118566.107811:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118566.107815:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118566.107816:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118566.108364:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118566.108367:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118566.108368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118566.108903:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787118566.119891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787118566.358021:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2739 MB/s 00000001:01000000:3.0:1787118566.608208:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2127 MB/s 00000001:01000000:3.0:1787118566.861279:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 478 MB/s 00000001:01000000:3.0:1787118567.111242:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 711 MB/s 00010000:00010000:1.0:1787118567.114862:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787118567.132508:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787118567.152209:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787118567.152224:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787118567.152227:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787118567.154766:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787118567.155161:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787118567.155217:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787118567.155445:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787118567.155488:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787118567.161325:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118567.161529:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787118567.161535:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787118567.167074:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787118567.167097:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787118567.169223:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787118567.169236:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787118567.169859:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787118567.169893:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.110@tcp' 00000020:01000004:1.0:1787118567.169895:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787118567.170149:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.110@tcp (typ=mgc) 00000020:00000080:1.0:1787118567.170169:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.110@tcp (000000008b35c996) 00000020:00000080:1.0:1787118567.170187:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787118567.170268:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d7e0c43c@MGC192.168.203.110@tcp: add connection 192.168.203.110@tcp at head 00010000:00010000:1.0:1787118567.170449:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.110@tcp-0 is initialized 00000040:01000000:1.0:1787118567.170456:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787118567.170617:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787118567.182403:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787118567.183708:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.110@tcp (uuid f5ef2904-bcdb-440a-9dd6-e4ff5e107e82) 00000020:00000080:1.0:1787118567.183750:0:5822:0:(genops.c:1406:class_connect()) connect: client f5ef2904-bcdb-440a-9dd6-e4ff5e107e82, cookie 0xaa534e3c784f8247 00000100:00080000:1.0:1787118567.183762:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.203.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787118567.183767:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.203.110@tcp: import 00000000d7e0c43c using connection 192.168.203.110@tcp/0@lo 00000100:00100000:1.0:1787118567.183815:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003d43d6c7 x1873929566158976/t0(0) o250->MGC192.168.203.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787118567.183849:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5ef2904-bcdb-440a-9dd6-e4ff5e107e82->MGS 00000020:01000004:1.0:1787118567.183881:0:5822:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787118567.183908:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787118567.183922:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000060f5d63a) 00000020:00000080:1.0:1787118567.183933:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787118567.184225:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003d43d6c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3297:1873929566158976:0@lo:250: 00000100:00100000:3.0:1787118567.184311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118567.184377:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566158976 00000100:00100000:3.0:1787118567.184384:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566158976 00000100:00100000:3.0:1787118567.184424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118567.184430:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a99d5174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1873929566158976:12345-0@lo:250: 00010000:00080000:3.0:1787118567.184451:0:5834:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from f5ef2904-bcdb-440a-9dd6-e4ff5e107e82@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:3.0:1787118567.184471:0:5834:0:(genops.c:1406:class_connect()) connect: client f5ef2904-bcdb-440a-9dd6-e4ff5e107e82, cookie 0xaa534e3c784f8255 00000100:00080000:3.0:1787118567.184597:0:5834:0:(import.c:65:import_set_state_nolock()) 000000007f0389d0 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118567.184646:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a99d5174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:3297:x1873929566158976:12345-0@lo:250: Request processed in 214us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118567.184653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118567.184692:0:3297:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787118567.184700:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.110@tcp: connect to target with instance 0 00000100:00080000:3.0:1787118567.184706:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787118567.184709:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787118567.184712:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000d7e0c43c MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787118567.184715:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787118567.184747:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787118567.184752:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003d43d6c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3297:1873929566158976:0@lo:250: 00000100:00100000:1.0:1787118567.207273:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118567.207453:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787118567.207459:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787118567.209003:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787118567.209014:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787118567.209396:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787118567.209403:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787118567.211491:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787118567.211659:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787118567.211664:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787118567.213383:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787118567.213394:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787118567.259959:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118567.260234:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787118567.260241:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787118567.265859:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787118567.265934:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787118567.267092:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118567.267344:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787118567.267350:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787118567.268112:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787118567.268183:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787118567.269028:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118567.269260:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787118567.269266:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787118567.270401:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787118567.270418:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787118567.271283:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118567.271629:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787118567.271681:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787118567.272566:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787118567.272573:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787118567.317718:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118567.318169:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787118567.318177:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787118567.319375:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787118567.319386:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787118567.321222:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787118567.321235:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787118567.322166:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787118567.322188:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787118567.322194:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787118567.322337:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787118567.322368:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.110@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787118567.322373:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787118567.322375:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787118567.322376:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787118567.322377:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787118567.322379:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787118567.322380:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787118567.322381:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787118567.322382:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787118567.322388:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787118567.322389:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787118567.322390:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787118567.322392:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787118567.322394:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787118567.322396:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787118567.322396:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787118567.322397:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787118567.322398:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787118567.322399:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787118567.322400:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787118567.322400:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787118567.322401:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787118567.322402:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787118567.322403:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787118567.322403:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787118567.322414:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787118567.322439:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787118567.322455:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b8709212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159104:0@lo:253: 00000100:00100000:1.0:1787118567.322526:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118567.322618:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159104 00000100:00100000:2.0:1787118567.322626:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159104 00000100:00100000:1.0:1787118567.322685:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be28b9a7 going to sleep for 11 seconds 00000100:00100000:2.0:1787118567.322845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118567.322854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eef82911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5822:x1873929566159104:12345-0@lo:253: 20000000:01000000:2.0:1787118567.322969:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787118567.322972:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787118567.324482:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787118567.325070:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787118567.325393:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787118567.327306:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787118567.328258:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787118567.328263:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787118567.328268:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787118567.328271:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787118567.328287:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787118567.328548:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118567.329157:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787118567.329172:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787118567.329234:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787118567.329287:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787118567.329336:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787118567.329445:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787118567.329454:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787118567.329501:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787118567.329509:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787118567.329541:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787118567.329549:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787118567.329582:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787118567.331373:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787118567.331479:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787118567.331487:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787118567.331504:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118567.333383:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787118567.333417:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787118567.333481:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787118567.333518:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787118567.333568:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787118567.333583:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787118567.333699:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787118567.333708:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787118567.333929:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787118567.333969:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787118567.334072:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787118567.334084:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787118567.334206:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787118567.334217:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787118567.334250:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787118567.334283:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787118567.334457:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787118567.334504:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787118567.334511:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787118567.335289:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787118567.335600:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787118567.335625:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.110@tcp for mdt 20000000:01000000:0.0:1787118567.335627:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.110@tcp (null) (null) (null) 00000040:00080000:0.0:1787118567.335714:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787118567.335914:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787118567.335954:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787118567.335962:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.110@tcp (null) (null) 00000040:00080000:0.0:1787118567.336022:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787118567.336033:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787118567.336066:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787118567.336099:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787118567.336163:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787118567.336166:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787118567.336171:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787118567.336177:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787118567.337073:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1787118567.337247:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787118567.348695:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787118567.348942:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787118567.349031:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787118567.349051:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787118567.349053:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787118567.349057:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787118567.349079:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787118567.349081:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787118567.349112:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787118567.349114:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787118567.350515:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787118567.351058:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787118567.351107:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787118567.351189:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1787118567.351203:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787118567.351205:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787118567.353295:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787118567.353700:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787118567.354429:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787118567.354471:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787118567.354487:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787118567.354489:0:5836:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787118567.354496:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787118567.354515:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354530:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354540:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354545:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354551:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354557:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354563:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009105a420 already unused, calling callback (00000000dd2f35e8) 00010000:00010000:2.0:1787118567.354577:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354583:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354595:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354602:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.354607:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009105a420/0xaa534e3c784f825c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787118567.354622:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787118567.647700:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eef82911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5822:x1873929566159104:12345-0@lo:253: Request processed in 324840us (325167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118567.647715:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118567.649622:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b8709212 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159104:0@lo:253: 10000000:01000000:0.0:1787118567.649641:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787118567.649644:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787118567.649647:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118567.649648:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118567.649649:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787118567.649650:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118567.649652:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118567.649653:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118567.649654:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118567.649656:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787118567.649657:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118567.649658:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787118567.649680:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a9ac10eb from lustre-MDT0000 10000000:01000000:0.0:1787118567.649705:0:5822:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787118567.649707:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787118567.649810:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff961346264d40 10000000:01000000:0.0:1787118567.649815:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787118567.649822:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff961346264d40 from 1 10000000:01000000:0.0:1787118567.649825:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787118567.649924:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118567.649935:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118567.649943:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118567.649962:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000488b084 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159232:0@lo:101: 00000100:00100000:0.0:1787118567.650103:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118567.650164:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000028ed5697 going to sleep for 11 seconds 00000100:00100000:3.0:1787118567.650830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159232 00000100:00100000:3.0:1787118567.650838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159232 00000100:00100000:3.0:1787118567.651064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787118567.651074:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b958ed5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5822:x1873929566159232:12345-0@lo:101: 00010000:00010000:3.0:1787118567.651107:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118567.651124:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000855dd571/0xaa534e3c784f826a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8263 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.651146:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000855dd571/0xaa534e3c784f826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.651155:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000855dd571/0xaa534e3c784f826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.651163:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000855dd571, rc 0) 00000100:00100000:3.0:1787118567.651279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b958ed5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5822:x1873929566159232:12345-0@lo:101: Request processed in 207us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118567.651285:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787118567.657716:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000488b084 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159232:0@lo:101: 00010000:00010000:2.0:1787118567.657899:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.657910:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118567.665697:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fd7faccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159360:0@lo:501: 00000100:00100000:3.0:1787118567.665787:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118567.665849:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055027b95 going to sleep for 11 seconds 00000100:00100000:0.0:1787118567.665979:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159360 00000100:00100000:0.0:1787118567.665987:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159360 00000100:00100000:0.0:1787118567.666030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118567.666037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000108f6c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5822:x1873929566159360:12345-0@lo:501: 00000100:00100000:0.0:1787118567.666268:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000108f6c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5822:x1873929566159360:12345-0@lo:501: Request processed in 231us (480us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787118567.666275:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787118567.666434:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fd7faccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159360:0@lo:501: 10000000:01000000:1.0:1787118567.666472:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787118567.666488:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.666497:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 0000000044633c1c/0xaa534e3c784f8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118567.666506:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff961347c3c800 10000000:01000000:1.0:1787118567.666511:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787118567.666524:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff961347c3c800 10000000:01000000:1.0:1787118567.666526:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787118567.666529:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff961347c3c800 from 1 10000000:01000000:1.0:1787118567.666531:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787118567.666556:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.666564:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.666572:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118567.666587:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159488:0@lo:101: 00000100:00100000:1.0:1787118567.666615:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118567.666638:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f8e8823 going to sleep for 11 seconds 00000100:00100000:3.0:1787118567.666870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159488 00000100:00100000:3.0:1787118567.666876:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159488 00000100:00100000:3.0:1787118567.666954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787118567.666961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5e057b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5822:x1873929566159488:12345-0@lo:101: 00010000:00010000:3.0:1787118567.666979:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118567.666992:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000256ec503/0xaa534e3c784f8278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8271 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.667011:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000256ec503/0xaa534e3c784f8278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8271 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.667020:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000256ec503/0xaa534e3c784f8278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8271 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118567.667027:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000256ec503, rc 0) 00000100:00100000:3.0:1787118567.667060:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5e057b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:5822:x1873929566159488:12345-0@lo:101: Request processed in 100us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118567.667066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787118567.674699:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159488:0@lo:101: 00010000:00010000:1.0:1787118567.674752:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.674765:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118567.674789:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787118567.674799:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.674805:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 000000006b3c86ea/0xaa534e3c784f8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118567.674835:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787118567.674840:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787118567.674846:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff961347c3c800 10000000:01000000:1.0:1787118567.674849:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787118567.674852:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787118567.674854:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787118567.674897:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.674904:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.674912:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118567.674927:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159616:0@lo:101: 00000100:00100000:1.0:1787118567.675382:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118567.675447:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f8e8823 going to sleep for 11 seconds 00000100:00100000:2.0:1787118567.675557:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159616 00000100:00100000:2.0:1787118567.675564:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159616 00000100:00100000:2.0:1787118567.675599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118567.675606:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062be0f20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:5822:x1873929566159616:12345-0@lo:101: 00010000:00010000:2.0:1787118567.675618:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118567.675630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009105a420/0xaa534e3c784f8286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f827f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.675662:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009105a420/0xaa534e3c784f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f827f expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.675671:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009105a420/0xaa534e3c784f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f827f expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118567.675679:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009105a420, rc 0) 00000100:00100000:2.0:1787118567.675716:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062be0f20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+8:5822:x1873929566159616:12345-0@lo:101: Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118567.675743:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787118567.675843:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159616:0@lo:101: 00010000:00010000:1.0:1787118567.675855:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118567.675862:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118567.676097:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159744:0@lo:501: 00000100:00100000:1.0:1787118567.676126:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118567.676152:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f8e8823 going to sleep for 11 seconds 00000100:00100000:2.0:1787118567.676280:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159744 00000100:00100000:2.0:1787118567.676284:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159744 00000100:00100000:2.0:1787118567.676313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118567.676318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2c1748d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+8:5822:x1873929566159744:12345-0@lo:501: 00000100:00100000:2.0:1787118567.676576:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2c1748d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5822:x1873929566159744:12345-0@lo:501: Request processed in 257us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118567.676584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118567.678003:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159744:0@lo:501: 00000100:00100000:1.0:1787118567.678055:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159872:0@lo:503: 00000100:00100000:1.0:1787118567.678116:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118567.678154:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f8e8823 going to sleep for 11 seconds 00000100:00100000:2.0:1787118567.678271:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566159872 00000100:00100000:2.0:1787118567.678277:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566159872 00000100:00100000:2.0:1787118567.678330:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787118567.678337:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009697470d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5822:x1873929566159872:12345-0@lo:503: 00000100:00100000:2.0:1787118567.678536:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009697470d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5822:x1873929566159872:12345-0@lo:503: Request processed in 199us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118567.678542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118567.678817:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566159872:0@lo:503: 00000100:00100000:1.0:1787118567.680935:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5864:1873929566160000:0@lo:502: 00000100:00100000:1.0:1787118567.681125:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118567.681171:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set 000000007d0c6987 going to sleep for 11 seconds 00000100:00100000:0.0:1787118567.681234:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160000 00000100:00100000:0.0:1787118567.681240:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160000 00000100:00100000:0.0:1787118567.681276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118567.681283:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db933395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5864:x1873929566160000:12345-0@lo:502: 00000100:00100000:0.0:1787118567.681491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db933395 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5864:x1873929566160000:12345-0@lo:502: Request processed in 208us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118567.681507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118567.681642:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5864:1873929566160000:0@lo:502: 00000020:01000000:1.0:1787118567.681673:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118567.681683:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118567.681686:0:5864:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787118567.681690:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787118567.681692:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787118567.681705:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ebce9078) 00000020:00000080:1.0:1787118567.681767:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787118567.681774:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787118567.681844:0:5864:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787118567.681850:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f8294 00000020:00000080:1.0:1787118567.682281:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787118567.682285:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118567.682288:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118567.682290:0:5864:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787118567.682292:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118567.682295:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118567.682296:0:5864:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787118567.682299:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787118567.682306:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000080b38866) 00000020:00000080:1.0:1787118567.682320:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787118567.682324:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787118567.682325:0:5864:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787118567.682328:0:5864:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787118567.682333:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787118567.683546:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9ac10eb from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787118567.683575:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008b683cb3) 00000020:00000080:1.0:1787118567.683588:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787118567.683644:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787118567.683650:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f82a9 00000020:00000080:1.0:1787118567.683807:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787118567.683813:0:5864:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787118567.683818:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa534e3c784f82b0 00080000:01000000:1.0:1787118567.683823:0:5864:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787118567.683826:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f82b7 00080000:10000000:1.0:1787118567.684685:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787118567.691490:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787118567.706223:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787118567.839795:0:5864:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787118567.841122:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787118567.848267:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787118567.850301:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787118567.943303:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000021ef85cb) 00000020:00000080:1.0:1787118567.943325:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787118567.943398:0:5864:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787118567.943420:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f82c5 00000020:00000080:2.0:1787118567.944742:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787118567.949631:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118568.083311:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118568.139337:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787118568.139992:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787118568.192128:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118568.262395:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118568.313395:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787118568.365707:0:5864:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa534e3c784f82cc 00000020:00000080:0.0:1787118568.366438:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787118568.366450:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118568.366988:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118568.366991:0:5864:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787118568.366997:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118568.367003:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118568.367004:0:5864:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787118568.367009:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787118568.367048:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787118568.367064:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118568.367067:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118568.367068:0:5864:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787118568.367071:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118568.367073:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118568.367075:0:5864:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787118568.367077:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787118568.367079:0:5864:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787118568.367119:0:5864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007100e5da pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5864:1873929566160128:0@lo:502: 00000100:00100000:0.0:1787118568.367198:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118568.367260:0:5864:0:(client.c:2702:ptlrpc_set_wait()) set 00000000350aaea4 going to sleep for 11 seconds 00000100:00100000:3.0:1787118568.367593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160128 00000100:00100000:3.0:1787118568.367603:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160128 00000100:00100000:3.0:1787118568.367661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787118568.367668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010901fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5864:x1873929566160128:12345-0@lo:502: 00000100:00100000:3.0:1787118568.368079:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010901fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5864:x1873929566160128:12345-0@lo:502: Request processed in 411us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118568.368087:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118568.368438:0:5864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007100e5da pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5864:1873929566160128:0@lo:502: 00000020:01000000:1.0:1787118568.368478:0:5864:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118568.368485:0:5864:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118568.368487:0:5864:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787118568.368491:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787118568.368818:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787118568.368839:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787118568.368859:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.368870:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 0000000016f2463c/0xaa534e3c784f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118568.368876:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff961347c3c800 from 1 10000000:01000000:2.0:1787118568.368879:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787118568.368921:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.368929:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.368937:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118568.368955:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160256:0@lo:101: 00000100:00100000:2.0:1787118568.368996:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.369026:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a027e2d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.369118:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160256 00000100:00100000:1.0:1787118568.369123:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160256 00000100:00100000:1.0:1787118568.369152:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118568.369159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f0500b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:5822:x1873929566160256:12345-0@lo:101: 00010000:00010000:1.0:1787118568.369169:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118568.369180:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f82d3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.369206:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.369215:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.369223:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd8f09be, rc 0) 00000100:00100000:1.0:1787118568.369255:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f0500b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:5822:x1873929566160256:12345-0@lo:101: Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.369261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787118568.369450:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160256:0@lo:101: 00010000:00010000:2.0:1787118568.369469:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.369477:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118568.370061:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160384:0@lo:256: 00000100:00100000:2.0:1787118568.370101:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.370129:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a027e2d8 going to sleep for 11 seconds 00000100:00100000:0.0:1787118568.370651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160384 00000100:00100000:0.0:1787118568.370657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160384 00000100:00100000:0.0:1787118568.370696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787118568.370704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033acd9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:5822:x1873929566160384:12345-0@lo:256: 20000000:01000000:0.0:1787118568.370747:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787118568.370753:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787118568.370817:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033acd9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:5822:x1873929566160384:12345-0@lo:256: Request processed in 114us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118568.370833:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787118568.371067:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160384:0@lo:256: 10000000:01000000:2.0:1787118568.371785:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787118568.371992:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.372004:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118568.372011:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961347c3c800 from 1 10000000:01000000:2.0:1787118568.372013:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787118568.372042:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.372049:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.372057:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118568.372073:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160512:0@lo:101: 00000100:00100000:2.0:1787118568.372217:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.372255:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a027e2d8 going to sleep for 11 seconds 00000100:00100000:0.0:1787118568.372479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160512 00000100:00100000:0.0:1787118568.372485:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160512 00000100:00100000:0.0:1787118568.372529:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118568.372536:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000921b2dd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:5822:x1873929566160512:12345-0@lo:101: 00010000:00010000:0.0:1787118568.372554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118568.372565:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f82e1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.372581:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.372587:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.372592:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f49b7322, rc 0) 00000100:00100000:0.0:1787118568.372638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000921b2dd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160512:12345-0@lo:101: Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118568.372644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118568.372707:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160512:0@lo:101: 00010000:00010000:2.0:1787118568.372719:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118568.372746:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118568.372925:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160640:0@lo:501: 00000100:00100000:2.0:1787118568.372954:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.372981:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a027e2d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.372986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160640 00000100:00100000:1.0:1787118568.372991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160640 00000100:00100000:1.0:1787118568.373022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787118568.373029:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fee5e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160640:12345-0@lo:501: 00000100:00100000:1.0:1787118568.374393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fee5e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160640:12345-0@lo:501: Request processed in 1362us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.374413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787118568.375012:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160640:0@lo:501: 00000100:00100000:2.0:1787118568.375058:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160768:0@lo:503: 00000100:00100000:2.0:1787118568.375108:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.375187:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a027e2d8 going to sleep for 11 seconds 00000100:00100000:3.0:1787118568.375230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160768 00000100:00100000:3.0:1787118568.375242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160768 00000100:00100000:3.0:1787118568.375315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787118568.375323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad88670c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160768:12345-0@lo:503: 00000040:00080000:3.0:1787118568.375366:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787118568.375427:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad88670c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160768:12345-0@lo:503: Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118568.375434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787118568.375518:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160768:0@lo:503: 00000040:00080000:2.0:1787118568.376442:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787118568.376600:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787118568.376617:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787118568.376636:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.376645:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118568.376687:0:5822:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787118568.376690:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff961347c3c800 10000000:01000000:1.0:1787118568.376693:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff961347c3c800 10000000:01000000:1.0:1787118568.376702:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787118568.376708:0:5822:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961347c3c800 from 1 10000000:01000000:1.0:1787118568.376710:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787118568.376766:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.376774:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.376781:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118568.376798:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160896:0@lo:101: 00000100:00100000:1.0:1787118568.376846:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118568.378188:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000232c0119 going to sleep for 11 seconds 00000100:00100000:0.0:1787118568.378260:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566160896 00000100:00100000:0.0:1787118568.378269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566160896 00000100:00100000:0.0:1787118568.378313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787118568.378321:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043568dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566160896:12345-0@lo:101: 00010000:00010000:0.0:1787118568.378336:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118568.378349:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007fedac10/0xaa534e3c784f82f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f82ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.378371:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007fedac10/0xaa534e3c784f82f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.378394:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007fedac10/0xaa534e3c784f82f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.378415:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007fedac10, rc 0) 00000100:00100000:0.0:1787118568.379314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043568dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566160896:12345-0@lo:101: Request processed in 989us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118568.379324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118568.379345:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566160896:0@lo:101: 00010000:00010000:1.0:1787118568.379363:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.379373:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118568.379533:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161024:0@lo:501: 00000100:00100000:1.0:1787118568.379770:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118568.379804:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000232c0119 going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.379827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161024 00000100:00100000:1.0:1787118568.379831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161024 00000100:00100000:1.0:1787118568.379863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787118568.379870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cc462bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566161024:12345-0@lo:501: 00000100:00100000:1.0:1787118568.380121:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cc462bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566161024:12345-0@lo:501: Request processed in 251us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.380129:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118568.380273:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021552c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161024:0@lo:501: 00000100:00100000:2.0:1787118568.380306:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161152:0@lo:503: 00000100:00100000:2.0:1787118568.380342:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118568.380362:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f707c41 going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.380409:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161152 00000100:00100000:1.0:1787118568.380414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161152 00000100:00100000:1.0:1787118568.381057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787118568.381067:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f3c0833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566161152:12345-0@lo:503: 00000100:00100000:1.0:1787118568.381381:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f3c0833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566161152:12345-0@lo:503: Request processed in 316us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.381389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118568.381474:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161152:0@lo:503: 00000100:00100000:3.0:1787118568.382143:0:5869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e8644be pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5869:1873929566161280:0@lo:502: 00000100:00100000:3.0:1787118568.382192:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118568.382227:0:5869:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a3b64655 going to sleep for 11 seconds 00000100:00100000:0.0:1787118568.382489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161280 00000100:00100000:0.0:1787118568.382495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161280 00000100:00100000:0.0:1787118568.382531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787118568.382537:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1373fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5869:x1873929566161280:12345-0@lo:502: 00000100:00100000:0.0:1787118568.383311:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1373fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5869:x1873929566161280:12345-0@lo:502: Request processed in 771us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118568.383320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787118568.383449:0:5869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e8644be pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5869:1873929566161280:0@lo:502: 00000020:01000004:3.0:1787118568.383508:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787118568.383522:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000617087f0) 00000020:00000080:3.0:1787118568.383539:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787118568.384213:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a9ac10eb from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787118568.384217:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a9ac10eb from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787118568.384224:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a9ac10eb 4 00010000:00080000:2.0:1787118568.384250:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000693fe171@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:2.0:1787118568.385854:0:5869:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787118568.385957:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787118568.385988:0:5869:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787118568.385998:0:5869:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa534e3c784f8304 00000100:00080000:2.0:1787118568.386007:0:5869:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787118568.386012:0:5869:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000693fe171 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118568.386043:0:5869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000992e0939 x1873929566161408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787118568.386067:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787118568.386544:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566161408:0@lo:38: 00000100:00100000:3.0:1787118568.386613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118568.386678:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161408 00000100:00100000:3.0:1787118568.386684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161408 00000100:00100000:3.0:1787118568.386710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118568.386716:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8644be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1873929566161408:12345-0@lo:38: 00000100:00100000:3.0:1787118568.386955:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8644be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1873929566161408:12345-0@lo:38: Request processed in 238us (342us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787118568.386963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118568.386997:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787118568.387003:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000693fe171 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787118568.387007:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787118568.387010:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992e0939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566161408:0@lo:38: 00000100:00100000:0.0:1787118568.388286:0:5869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000af35cb10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5869:1873929566161536:0@lo:502: 00000100:00100000:0.0:1787118568.388353:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118568.388392:0:5869:0:(client.c:2702:ptlrpc_set_wait()) set 0000000027c21c8a going to sleep for 11 seconds 00000100:00100000:3.0:1787118568.388446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161536 00000100:00100000:3.0:1787118568.388452:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161536 00000100:00100000:3.0:1787118568.388493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787118568.388500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8019f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5869:x1873929566161536:12345-0@lo:502: 00000100:00100000:2.0:1787118568.389836:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8019f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5869:x1873929566161536:12345-0@lo:502: Request processed in 1333us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118568.389849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787118568.390438:0:5869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000af35cb10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5869:1873929566161536:0@lo:502: 00000040:00080000:3.0:1787118568.390472:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787118568.393135:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787118568.393170:0:5822:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787118568.393185:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.393197:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 00000000c73439f6/0xaa534e3c784f82ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787118568.393250:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787118568.393253:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118568.393258:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118568.393259:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118568.393260:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118568.393262:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118568.393263:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118568.393264:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118568.393265:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118568.393266:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118568.393267:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118568.393268:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787118568.393271:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787118568.393274:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787118568.393275:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118568.393275:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118568.393276:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118568.393277:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118568.393278:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118568.393278:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118568.393279:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118568.393280:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118568.393280:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118568.393281:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118568.393282:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787118568.393307:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787118568.393323:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000561d04f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161664:0@lo:253: 00000100:00100000:0.0:1787118568.393389:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118568.393438:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000023f786a7 going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.394482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161664 00000100:00100000:1.0:1787118568.394491:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161664 00000100:00100000:1.0:1787118568.394533:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787118568.394540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015d046d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5822:x1873929566161664:12345-0@lo:253: 20000000:01000000:1.0:1787118568.395154:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787118568.395171:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787118568.458307:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787118568.458329:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787118568.458949:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787118568.458955:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787118568.458976:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.458994:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.459001:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.459057:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.459069:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 12 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118568.459088:0:5857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f764f879 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566161792:0@lo:104: 00000100:00100000:0.0:1787118568.459148:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118568.459247:0:5857:0:(client.c:2702:ptlrpc_set_wait()) set 00000000142c4ece going to sleep for 11 seconds 00000100:00100000:1.0:1787118568.459999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161792 00000100:00100000:1.0:1787118568.460007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161792 00000100:00100000:1.0:1787118568.460059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787118568.460068:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080313aa3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566161792:12345-0@lo:104: 00010000:00010000:1.0:1787118568.460080:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460143:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118568.460148:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080313aa3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566161792:12345-0@lo:104: Request processed in 82us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.460166:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787118568.460186:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118568.460190:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460198:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f139bf8e already unused, calling callback (000000004cd78b79) 10000000:00010000:1.0:1787118568.460200:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460207:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118568.460213:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118568.460218:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118568.460248:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460255:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118568.460273:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460279:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: 00000000f139bf8e/0xaa534e3c784f82d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82da expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118568.460295:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118568.460297:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118568.460298:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118568.460352:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000d866420 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566161920:0@lo:103: 00000100:00100000:1.0:1787118568.460388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118568.460838:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566161920 00000100:00100000:0.0:1787118568.460843:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566161920 00010000:00010000:0.0:1787118568.460873:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 13 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118568.460895:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118568.460902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec54709b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3299:x1873929566161920:12345-0@lo:103: 00010000:00010000:0.0:1787118568.460912:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118568.460916:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 13 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460929:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 13 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460945:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460951:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787118568.460975:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002020980s 00010000:00010000:0.0:1787118568.460979:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460985:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460989:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460994:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.460999:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9130121 already unused, calling callback (00000000dd2f35e8) 00010000:00010000:0.0:1787118568.461002:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.461007:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.461013:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118568.461022:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118568.461051:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec54709b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3299:x1873929566161920:12345-0@lo:103: Request processed in 150us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118568.461057:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787118568.461215:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd8f09be/0xaa534e3c784f82da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f82d3 expref: 12 pid: 5836 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118568.461227:0:5857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f764f879 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566161792:0@lo:104: 00010000:00010000:3.0:1787118568.461243:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118568.461251:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118568.461256:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118568.461260:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e9130121/0xaa534e3c784f830b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118568.465769:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000d866420 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566161920:0@lo:103: 00000100:00100000:1.0:1787118568.488310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015d046d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5822:x1873929566161664:12345-0@lo:253: Request processed in 93763us (94913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118568.488325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787118568.488436:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000561d04f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5822:1873929566161664:0@lo:253: 10000000:01000000:0.0:1787118568.488461:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787118568.488476:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787118568.488478:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118568.488479:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118568.488480:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118568.488482:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118568.488483:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118568.488484:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118568.488485:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118568.488487:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118568.488488:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118568.488489:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118568.488491:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787118568.488504:0:5822:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787118568.507937:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.508937:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787118568.509265:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.509535:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787118568.510128:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.510303:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787118568.511951:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.512224:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787118568.512798:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.513138:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787118568.513334:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787118568.514838:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787118568.639535:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787118568.757889:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787118568.763603:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1787118568.773712:0:5874:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787118568.773739:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787118568.783457:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787118568.785202:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787118568.791209:0:5822:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787118568.791256:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787118568.791560:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787118568.795296:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787118568.802202:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787118568.802270:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787118568.802548:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787118568.802762:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787118568.804078:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787118568.804225:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787118568.804364:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787118568.810946:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787118568.811147:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787118568.811324:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787118568.811506:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787118568.812210:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787118568.812355:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787118568.812518:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787118568.813361:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787118568.813567:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787118568.814151:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787118568.814351:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787118568.814507:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787118568.815560:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787118568.818220:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787118568.818407:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787118568.818715:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787118568.819841:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787118568.821303:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787118568.821521:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787118568.824090:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787118568.824426:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787118568.827174:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787118568.830066:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787118568.831453:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787118568.833508:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787118568.837790:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787118568.838013:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787118568.838156:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787118568.838326:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787118568.838544:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787118568.861623:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787118568.930764:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787118568.930800:0:5822:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa89d4153f988 00100000:10000000:1.0:1787118568.930808:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787118568.931491:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787118568.931506:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787118568.931522:0:5822:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787118568.931560:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787118569.021778:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787118569.021870:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1787118569.021874:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787118569.168131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118570.189169:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118571.211004:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118572.239671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118573.264771:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787118573.900614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787118573.900624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787118573.900627:0:37:0:(import.c:65:import_set_state_nolock()) 00000000693fe171 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787118573.900647:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000693fe171 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118573.900669:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ae51f16 x1873929566162176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787118573.900709:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001ae51f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566162176:0@lo:38: 00000100:00100000:1.0:1787118573.900747:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118573.900762:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b74db3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566162048:0@lo:400: 00000100:00100000:2.0:1787118573.900931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118573.901386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118573.901445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162176 00000100:00100000:1.0:1787118573.901453:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162176 00000100:00100000:1.0:1787118573.901495:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118573.901508:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d378318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566162176:12345-0@lo:38: 00010000:00080000:1.0:1787118573.901531:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1787118573.901564:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa534e3c784f8312 00000004:00100000:1.0:1787118573.901604:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787118573.901704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162048 00000100:00100000:2.0:1787118573.901709:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162048 00000100:00080000:1.0:1787118573.901745:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000cd16c55e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118573.901799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d378318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873929566162176:12345-0@lo:38: Request processed in 291us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118573.901808:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787118573.901833:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001ae51f16 x1873929566162176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787118573.901849:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787118573.901925:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787118573.901931:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787118573.901933:0:3297:0:(import.c:65:import_set_state_nolock()) 00000000693fe171 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787118573.901940:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001ae51f16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566162176:0@lo:38: 00000100:00100000:3.0:1787118573.903174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787118573.903186:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b4058d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:3301:x1873929566162048:12345-0@lo:400: 00000100:00100000:3.0:1787118573.903262:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b4058d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:3301:x1873929566162048:12345-0@lo:400: Request processed in 78us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118573.903269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787118573.903457:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b74db3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566162048:0@lo:400: 00000001:02000400:3.0:1787118573.945322:0:6118:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787118574.287025:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787118574.931976:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787118574.931983:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff961347c3c800 from 3 10000000:01000000:3.0:1787118574.931988:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787118574.932035:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118574.932047:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118574.932057:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118574.932077:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566162304:0@lo:101: 00000100:00100000:3.0:1787118574.932140:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118574.932185:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ae35d72d going to sleep for 11 seconds 00000100:00100000:1.0:1787118574.932933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162304 00000100:00100000:1.0:1787118574.932942:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162304 00000100:00100000:1.0:1787118574.932982:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787118574.932989:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064caf581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5838:x1873929566162304:12345-0@lo:101: 00010000:00010000:1.0:1787118574.933001:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118574.933013:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c4f479f/0xaa534e3c784f8320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8319 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118574.933034:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c4f479f/0xaa534e3c784f8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118574.933043:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c4f479f/0xaa534e3c784f8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118574.933061:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c4f479f, rc 0) 00000100:00100000:1.0:1787118574.933108:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064caf581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566162304:12345-0@lo:101: Request processed in 119us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118574.933115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118574.933805:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566162304:0@lo:101: 00010000:00010000:3.0:1787118574.933941:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118574.933952:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118574.934009:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566162432:0@lo:256: 00000100:00100000:3.0:1787118574.934059:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118574.934093:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ae35d72d going to sleep for 11 seconds 00000100:00100000:1.0:1787118574.934153:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162432 00000100:00100000:1.0:1787118574.934165:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162432 00000100:00100000:1.0:1787118574.934236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787118574.934243:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43fa9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566162432:12345-0@lo:256: 20000000:01000000:1.0:1787118574.934260:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787118574.934274:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787118574.934277:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787118574.934381:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43fa9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566162432:12345-0@lo:256: Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118574.934388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787118574.934636:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566162432:0@lo:256: 10000000:01000000:3.0:1787118574.934691:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787118574.934697:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118574.934704:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: 000000001a910030/0xaa534e3c784f8319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118575.308228:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118576.330079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118577.354028:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118578.378488:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118579.017999:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d00de7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566162688:0@lo:400: 00000100:00100000:2.0:1787118579.018068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118579.018145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162688 00000100:00100000:2.0:1787118579.018151:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162688 00000100:00100000:2.0:1787118579.018191:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118579.018199:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000023de5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566162688:12345-0@lo:400: 00000100:00100000:2.0:1787118579.018249:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000023de5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566162688:12345-0@lo:400: Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118579.018256:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787118579.018295:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d00de7ca x1873929566162688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118579.018307:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d00de7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566162688:0@lo:400: 00000100:00100000:3.0:1787118579.018376:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b74db3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566162560:0@lo:400: 00000100:00100000:3.0:1787118579.018414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118579.018593:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162560 00000100:00100000:2.0:1787118579.018597:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162560 00000100:00100000:2.0:1787118579.018633:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787118579.018639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1d974c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3301:x1873929566162560:12345-0@lo:400: 00000100:00100000:2.0:1787118579.018681:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1d974c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3301:x1873929566162560:12345-0@lo:400: Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118579.018688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787118579.018761:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b74db3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566162560:0@lo:400: 00000020:00000080:2.0:1787118579.115639:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff724db80 20000000:00000080:2.0:1787118579.115657:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96137b475c00 uarg=0000000000000000 20000000:01000000:2.0:1787118579.115691:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787118579.115698:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787118579.115703:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787118579.116072:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787118579.116083:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787118579.125595:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118579.126082:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787118579.126139:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787118579.126207:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787118579.126226:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787118579.126242:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.126269:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.126275:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.126311:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.126323:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 11 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118579.126349:0:6321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000561d04f5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1873929566162816:0@lo:104: 00000100:00100000:0.0:1787118579.126413:0:6321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118579.126473:0:6321:0:(client.c:2702:ptlrpc_set_wait()) set 00000000093b1f7c going to sleep for 11 seconds 00000100:00100000:1.0:1787118579.126593:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162816 00000100:00100000:1.0:1787118579.126602:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162816 00000100:00100000:1.0:1787118579.126655:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118579.126664:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d1d146 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:6321:x1873929566162816:12345-0@lo:104: 00010000:00010000:1.0:1787118579.126675:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.126744:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118579.126749:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d1d146 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:6321:x1873929566162816:12345-0@lo:104: Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118579.126756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118579.126833:0:6321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000561d04f5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1873929566162816:0@lo:104: 00010000:00010000:0.0:1787118579.126851:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.129974:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118579.129987:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.129999:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000995ff13 already unused, calling callback (000000004cd78b79) 10000000:00010000:3.0:1787118579.130002:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.130010:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118579.130016:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118579.130021:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787118579.130070:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.130077:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118579.130093:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.130099:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: 000000000995ff13/0xaa534e3c784f82e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82e8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118579.130132:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118579.130134:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118579.130135:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118579.131075:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118579.131109:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566162944:0@lo:103: 00000100:00100000:2.0:1787118579.131207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118579.131277:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566162944 00000100:00100000:1.0:1787118579.131290:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566162944 00010000:00010000:1.0:1787118579.131337:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118579.131384:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118579.131394:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00de7ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3298:x1873929566162944:12345-0@lo:103: 00010000:00010000:1.0:1787118579.131421:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118579.131426:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131437:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131451:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f49b7322/0xaa534e3c784f82e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f82e1 expref: 12 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131466:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131474:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131488:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131494:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131500:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131505:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131511:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a801270a already unused, calling callback (00000000dd2f35e8) 00010000:00010000:1.0:1787118579.131515:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131531:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131549:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118579.131560:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118579.131584:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.131591:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118579.131596:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a801270a/0xaa534e3c784f8327 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118579.132441:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00de7ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:3298:x1873929566162944:12345-0@lo:103: Request processed in 1045us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118579.132452:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787118579.134357:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566162944:0@lo:103: 00010000:00010000:2.0:1787118579.403557:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118580.432560:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118581.451762:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118582.498903:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118583.572483:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118584.141167:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000132dae7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566163200:0@lo:400: 00000100:00100000:1.0:1787118584.141239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118584.141316:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118584.141323:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048207105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566163072:0@lo:400: 00000100:00100000:1.0:1787118584.141490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118584.141553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163200 00000100:00100000:2.0:1787118584.141560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163200 00000100:00100000:2.0:1787118584.141610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118584.141618:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d866420 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566163200:12345-0@lo:400: 00000100:00100000:2.0:1787118584.141667:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d866420 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566163200:12345-0@lo:400: Request processed in 50us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118584.141674:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787118584.141845:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000132dae7d x1873929566163200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118584.141859:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000132dae7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566163200:0@lo:400: 00000100:00100000:3.0:1787118584.142018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163072 00000100:00100000:3.0:1787118584.142022:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163072 00000100:00100000:3.0:1787118584.142050:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787118584.142056:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b22345b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:3301:x1873929566163072:12345-0@lo:400: 00000100:00100000:3.0:1787118584.142100:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b22345b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:3301:x1873929566163072:12345-0@lo:400: Request processed in 45us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118584.142106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787118584.142283:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048207105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566163072:0@lo:400: 00010000:00010000:0.0:1787118584.590213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787118584.651130:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787118584.651136:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961347c3c800 from 1 10000000:01000000:3.0:1787118584.651141:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787118584.651184:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: 000000002b0ba27d/0xaa534e3c784f832e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118584.651196:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: 000000002b0ba27d/0xaa534e3c784f832e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118584.651207:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: 000000002b0ba27d/0xaa534e3c784f832e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118584.651230:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163328:0@lo:101: 00000100:00100000:3.0:1787118584.651306:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118584.651362:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb7ba9e going to sleep for 11 seconds 00000100:00100000:0.0:1787118584.651445:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163328 00000100:00100000:0.0:1787118584.651453:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163328 00000100:00100000:0.0:1787118584.651494:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787118584.651865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e69d8f86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:5838:x1873929566163328:12345-0@lo:101: 00010000:00010000:0.0:1787118584.651881:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118584.651895:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b43b75d7/0xaa534e3c784f8335 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f832e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118584.651916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b43b75d7/0xaa534e3c784f8335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f832e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118584.651926:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b43b75d7/0xaa534e3c784f8335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f832e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118584.651934:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b43b75d7, rc 0) 00000100:00100000:0.0:1787118584.651982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e69d8f86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566163328:12345-0@lo:101: Request processed in 481us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118584.652501:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000037ff6a93 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163328:0@lo:101: 00010000:00010000:1.0:1787118584.652517:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: 000000002b0ba27d/0xaa534e3c784f832e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118584.652526:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: 000000002b0ba27d/0xaa534e3c784f832e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118584.652609:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000060399fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163456:0@lo:501: 00000100:00100000:1.0:1787118584.652646:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118584.652678:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ba779084 going to sleep for 11 seconds 00000100:00100000:1.0:1787118584.652693:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163456 00000100:00100000:1.0:1787118584.652697:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163456 00000100:00100000:0.0:1787118584.661095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787118584.661145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118584.661163:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c449c749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566163456:12345-0@lo:501: 00000100:00100000:1.0:1787118584.662196:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c449c749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566163456:12345-0@lo:501: Request processed in 1037us (9544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118584.662206:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787118584.662299:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000060399fa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163456:0@lo:501: 00000100:00100000:3.0:1787118584.663982:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e910b261 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163584:0@lo:503: 00000100:00100000:3.0:1787118584.664060:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118584.664158:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set 000000000cb7ba9e going to sleep for 11 seconds 00000100:00100000:0.0:1787118584.664201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163584 00000100:00100000:0.0:1787118584.664207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163584 00000100:00100000:0.0:1787118584.664283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787118584.664300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b2d2e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566163584:12345-0@lo:503: 00000100:00100000:0.0:1787118584.664575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b2d2e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566163584:12345-0@lo:503: Request processed in 285us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118584.664591:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787118584.664667:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e910b261 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566163584:0@lo:503: 00000100:00100000:1.0:1787118584.664905:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a02ebbd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6630:1873929566163712:0@lo:502: 00000100:00100000:1.0:1787118584.664943:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118584.665449:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set 0000000036804508 going to sleep for 11 seconds 00000100:00100000:3.0:1787118584.665551:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163712 00000100:00100000:3.0:1787118584.665557:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163712 00000100:00100000:3.0:1787118584.665592:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787118584.665599:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000035c7ad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6630:x1873929566163712:12345-0@lo:502: 00000100:00100000:3.0:1787118584.665983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000035c7ad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6630:x1873929566163712:12345-0@lo:502: Request processed in 384us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118584.665990:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787118584.666089:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a02ebbd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6630:1873929566163712:0@lo:502: 00000020:01000000:1.0:1787118584.666118:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118584.666127:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118584.666129:0:6630:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787118584.666135:0:6630:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961347c3c800 00000020:00000080:1.0:1787118584.666138:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787118584.666178:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6630:1873929566163840:0@lo:502: 00000100:00100000:1.0:1787118584.666213:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118584.666243:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613507e19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118584.666282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163840 00000100:00100000:3.0:1787118584.666286:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163840 00000100:00100000:3.0:1787118584.666314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787118584.666319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6630:x1873929566163840:12345-0@lo:502: 00000100:00100000:3.0:1787118584.666523:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6630:x1873929566163840:12345-0@lo:502: Request processed in 203us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118584.666529:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787118584.666672:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6630:1873929566163840:0@lo:502: 00000020:01000000:1.0:1787118584.666692:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118584.666702:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118584.666704:0:6630:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787118584.666708:0:6630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787118584.666796:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787118584.666810:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787118584.666819:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118584.666831:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118585.615252:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787118586.281841:0:6700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787118586.281845:0:6700:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787118586.281969:0:6700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff961375697800 00000020:01000004:2.0:1787118586.281987:0:6700:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787118586.281998:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787118586.282020:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff961343f03380) 00000020:00000080:2.0:1787118586.282036:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787118586.298108:0:6700:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787118586.298371:0:6700:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787118586.317993:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787118586.326065:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787118586.326115:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787118586.326170:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787118586.326198:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787118586.326564:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787118586.326574:0:6700:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787118586.326582:0:6700:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa534e3c784f8343 00000020:01000004:2.0:1787118586.326589:0:6700:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787118586.326606:0:6700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787118586.326608:0:6700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787118586.326613:0:6700:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787118586.326617:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787118586.326627:0:6700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff961343f00000) 00000020:00000080:2.0:1787118586.326636:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787118586.332593:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787118586.332831:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787118586.332838:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787118586.337509:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787118586.337527:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787118586.338107:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787118586.338115:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787118586.339526:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118586.339705:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787118586.339712:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787118586.341189:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787118586.341205:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787118586.384325:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118586.384580:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787118586.384588:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787118586.406446:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787118586.406488:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787118586.412992:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787118586.413012:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787118586.418154:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118586.418441:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787118586.418448:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787118586.420924:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787118586.420937:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787118586.536714:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118586.537115:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787118586.537122:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787118586.542948:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787118586.542965:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787118586.547338:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787118586.547364:0:6700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787118586.547370:0:6700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787118586.593971:0:6700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787118586.594014:0:6700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.110@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787118586.594018:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787118586.594020:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787118586.594021:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118586.594022:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118586.594026:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118586.594027:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118586.594028:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118586.594029:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787118586.594030:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787118586.594032:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118586.594033:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787118586.594037:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787118586.594039:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787118586.594040:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787118586.594041:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118586.594041:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118586.594042:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118586.594043:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118586.594044:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118586.594044:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787118586.594045:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787118586.594046:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118586.594047:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787118586.594072:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787118586.594090:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566163968:0@lo:253: 00000100:00100000:3.0:1787118586.594159:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.594221:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342a340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.594334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566163968 00000100:00100000:2.0:1787118586.594342:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566163968 00000100:00100000:2.0:1787118586.594386:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787118586.594395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566163968:12345-0@lo:253: 20000000:01000000:2.0:1787118586.594432:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787118586.594437:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787118586.594442:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787118586.594445:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787118586.596768:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787118586.597607:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787118586.597626:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787118586.597676:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787118586.597685:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787118586.597775:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787118586.597832:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787118586.603594:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787118586.603632:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.110@tcp 20000000:01000000:1.0:1787118586.603635:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787118586.603675:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787118586.603697:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787118586.603775:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787118586.603785:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.110@tcp (null) (null) 00000040:00080000:1.0:1787118586.603819:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787118586.603829:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787118586.603859:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787118586.603911:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787118586.609229:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787118586.609260:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.110@tcp 20000000:01000000:1.0:1787118586.609263:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787118586.609314:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787118586.609323:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787118586.609537:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787118586.609547:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.110@tcp (null) (null) 00000040:00080000:1.0:1787118586.609594:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787118586.609605:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787118586.609638:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787118586.609672:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787118586.609686:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787118586.609688:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787118586.609692:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787118586.609703:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787118586.609706:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787118586.611410:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787118586.611416:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787118586.616669:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787118586.616814:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787118586.616869:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787118586.617767:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787118586.617807:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787118586.617865:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787118586.617877:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787118586.617880:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787118586.619631:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787118586.619706:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787118586.619837:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787118586.620206:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787118586.620249:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787118586.620298:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787118586.620311:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787118586.620322:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787118586.623710:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787118586.625665:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787118586.625717:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787118586.625865:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787118586.625886:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787118586.625888:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787118586.625898:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787118586.625917:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.625934:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.625942:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f827f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.625949:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.625956:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.625995:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.626009:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118586.626024:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164096:0@lo:104: 00000100:00100000:2.0:1787118586.626101:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787118586.626165:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.626184:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 12 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118586.626193:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164224:0@lo:104: 00000100:00100000:2.0:1787118586.626215:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787118586.626234:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.626242:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 12 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118586.626251:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164352:0@lo:104: 00000100:00100000:2.0:1787118586.626267:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118586.626285:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136004c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.626921:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164096 00000100:00100000:0.0:1787118586.626930:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164096 00000100:00100000:0.0:1787118586.626969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164224 00000100:00100000:0.0:1787118586.626973:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164224 00000100:00100000:0.0:1787118586.626986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164352 00000100:00100000:0.0:1787118586.626989:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164352 00000100:00100000:3.0:1787118586.626996:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787118586.627011:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5834:x1873929566164096:12345-0@lo:104: 00010000:00010000:3.0:1787118586.627026:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.627100:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118586.627116:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5834:x1873929566164096:12345-0@lo:104: Request processed in 110us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118586.627125:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787118586.627146:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787118586.627153:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:5834:x1873929566164224:12345-0@lo:104: 00010000:00010000:3.0:1787118586.627161:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.627195:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787118586.627200:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:5834:x1873929566164224:12345-0@lo:104: Request processed in 48us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118586.627216:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787118586.627230:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787118586.627236:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5834:x1873929566164352:12345-0@lo:104: 00010000:00010000:3.0:1787118586.627243:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.627293:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787118586.627299:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5834:x1873929566164352:12345-0@lo:104: Request processed in 64us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118586.627305:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787118586.629452:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787118586.629465:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629476:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118586.629480:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629490:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118586.629498:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118586.629504:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787118586.629561:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629580:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118586.629604:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629612:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f82ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f82f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629630:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787118586.629634:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629639:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042800 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118586.629642:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629648:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118586.629655:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118586.629660:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787118586.629673:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629678:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118586.629683:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629688:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f827f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8286 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629703:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118586.629706:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629711:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118586.629714:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629751:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118586.629759:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118586.629764:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787118586.629782:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629787:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118586.629802:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629808:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340030800/0xaa534e3c784f8263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f826a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.629821:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118586.629822:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118586.629824:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118586.629841:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566164480:0@lo:103: 00000100:00100000:0.0:1787118586.629905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.629952:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118586.629959:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566164608:0@lo:103: 00000100:00100000:0.0:1787118586.629977:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.630005:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566164736:0@lo:103: 00000100:00100000:0.0:1787118586.630028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.630063:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164480 00000100:00100000:0.0:1787118586.630069:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164480 00010000:00010000:0.0:1787118586.630091:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 13 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.630110:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164608 00000100:00100000:0.0:1787118586.630112:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164608 00010000:00010000:0.0:1787118586.630123:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 14 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.630132:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164736 00000100:00100000:0.0:1787118586.630134:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164736 00010000:00010000:0.0:1787118586.630142:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 15 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.630155:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118586.630163:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3298:x1873929566164480:12345-0@lo:103: 00010000:00010000:0.0:1787118586.630174:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118586.630179:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 15 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630189:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 15 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630219:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118586.630251:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3298:x1873929566164480:12345-0@lo:103: Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.630259:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118586.630285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118586.630292:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3298:x1873929566164608:12345-0@lo:103: 00010000:00010000:0.0:1787118586.630299:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118586.630303:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 14 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630312:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 14 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630321:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118586.630354:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3298:x1873929566164608:12345-0@lo:103: Request processed in 63us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.630360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118586.630371:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787118586.630377:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3300:x1873929566164736:12345-0@lo:103: 00010000:00010000:0.0:1787118586.630383:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118586.630387:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 13 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630394:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 13 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630406:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630419:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630434:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630441:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630447:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630453:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630459:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382175e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118586.630463:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630470:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630479:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.630488:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118586.630517:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3300:x1873929566164736:12345-0@lo:103: Request processed in 140us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.630523:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787118586.630561:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566164736:0@lo:103: 00000100:00100000:0.0:1787118586.630593:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566164608:0@lo:103: 00000100:00100000:0.0:1787118586.630601:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566164480:0@lo:103: 00010000:00010000:0.0:1787118586.630965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031000/0xaa534e3c784f82f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f82ef expref: 12 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.630977:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164096:0@lo:104: 00010000:00010000:0.0:1787118586.630989:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382174800/0xaa534e3c784f8286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f827f expref: 11 pid: 5836 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.630998:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164224:0@lo:104: 00010000:00010000:0.0:1787118586.631008:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613414b0400/0xaa534e3c784f826a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8263 expref: 10 pid: 5835 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.631016:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1873929566164352:0@lo:104: 00010000:00010000:0.0:1787118586.631035:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.631044:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.631050:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.631057:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382175e00/0xaa534e3c784f8351 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787118586.631072:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1787118586.633347:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118586.635499:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118586.733899:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:6700:x1873929566163968:12345-0@lo:253: Request processed in 139496us (139731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118586.733914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787118586.734704:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566163968:0@lo:253: 10000000:01000000:3.0:1787118586.734758:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787118586.734762:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787118586.734764:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787118586.734765:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118586.734766:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787118586.734768:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118586.734783:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118586.734785:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118586.734786:0:6700:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787118586.734788:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118586.734789:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787118586.734810:0:6700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff961375697800 from lustre-OST0000 10000000:01000000:3.0:1787118586.734835:0:6700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787118586.734838:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787118586.734844:0:6700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff961346264d40 local copy 10000000:01000000:3.0:1787118586.734848:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787118586.734885:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.734896:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.734905:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118586.734924:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566164864:0@lo:101: 00000100:00100000:3.0:1787118586.734968:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.735033:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886900 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.735167:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164864 00000100:00100000:2.0:1787118586.735174:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164864 00000100:00100000:2.0:1787118586.735215:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787118586.735224:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:6700:x1873929566164864:12345-0@lo:101: 00010000:00010000:2.0:1787118586.735235:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118586.735247:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382175600/0xaa534e3c784f835f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8358 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.735268:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382175600/0xaa534e3c784f835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8358 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.735289:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382175600/0xaa534e3c784f835f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8358 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.735307:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382175600, rc 0) 00000100:00100000:2.0:1787118586.735350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:6700:x1873929566164864:12345-0@lo:101: Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.735357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787118586.735563:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566164864:0@lo:101: 00010000:00010000:3.0:1787118586.735577:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.736208:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118586.736347:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566164992:0@lo:501: 00000100:00100000:3.0:1787118586.736386:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.736476:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118586.746222:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566164992 00000100:00100000:1.0:1787118586.746236:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566164992 00000100:00100000:0.0:1787118586.749082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787118586.749108:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:6700:x1873929566164992:12345-0@lo:501: 00000100:00100000:0.0:1787118586.749418:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:6700:x1873929566164992:12345-0@lo:501: Request processed in 312us (13031us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787118586.749426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787118586.749523:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566164992:0@lo:501: 10000000:01000000:3.0:1787118586.749545:0:6700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787118586.749580:0:6700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787118586.749602:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.749613:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.749622:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.749648:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787118586.749671:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff961375697800 10000000:01000000:3.0:1787118586.749676:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787118586.749681:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff961346264d40 10000000:01000000:3.0:1787118586.749683:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787118586.749686:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff961346264d40 from 1 10000000:01000000:3.0:1787118586.749689:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787118586.749717:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.749745:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.749754:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118586.749772:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165120:0@lo:101: 00000100:00100000:3.0:1787118586.749813:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118586.751628:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118586.751642:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.751654:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613414b0e00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118586.751658:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.751667:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118586.751674:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118586.751680:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118586.751715:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.751750:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118586.751773:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.751780:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff9613414b0e00/0xaa534e3c784f8358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f835f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.751801:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118586.751803:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118586.751804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118586.751820:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566165248:0@lo:103: 00000100:00100000:1.0:1787118586.751877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.751954:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165248 00000100:00100000:1.0:1787118586.751973:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165248 00000100:00100000:1.0:1787118586.752015:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787118586.752023:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:3301:x1873929566165248:12345-0@lo:103: 00010000:00010000:1.0:1787118586.752035:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118586.752048:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382175600/0xaa534e3c784f835f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8358 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.752061:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118586.752094:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:3301:x1873929566165248:12345-0@lo:103: Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118586.752102:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787118586.752138:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566165248:0@lo:103: 00000100:00100000:3.0:1787118586.754220:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.754385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165120 00000100:00100000:2.0:1787118586.754393:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165120 00000100:00100000:2.0:1787118586.754433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787118586.754441:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:6700:x1873929566165120:12345-0@lo:101: 00010000:00010000:2.0:1787118586.754456:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118586.754474:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382175e00/0xaa534e3c784f836d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8366 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.754496:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382175e00/0xaa534e3c784f836d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8366 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.754505:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382175e00/0xaa534e3c784f836d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8366 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.754514:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382175e00, rc 0) 00000100:00100000:2.0:1787118586.754576:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:6700:x1873929566165120:12345-0@lo:101: Request processed in 135us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118586.754717:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165120:0@lo:101: 00010000:00010000:3.0:1787118586.754749:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.754758:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118586.754777:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787118586.754787:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.754794:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118586.754801:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787118586.754805:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787118586.754810:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787118586.754812:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787118586.754832:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.754839:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.754847:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118586.754862:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165376:0@lo:101: 00000100:00100000:3.0:1787118586.754912:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.754930:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.754988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787118586.755022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165376 00000100:00100000:2.0:1787118586.755026:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165376 00000100:00100000:2.0:1787118586.755041:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787118586.755047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+10:6700:x1873929566165376:12345-0@lo:101: 00010000:00010000:2.0:1787118586.755054:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118586.755082:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8374 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.755096:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.755103:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.755109:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382174800, rc 0) 00000100:00100000:2.0:1787118586.755145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165376:12345-0@lo:101: Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.755151:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787118586.755259:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165376:0@lo:101: 00010000:00010000:3.0:1787118586.755270:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.755288:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118586.755376:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165504:0@lo:501: 00000100:00100000:3.0:1787118586.755401:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.755427:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.755478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165504 00000100:00100000:2.0:1787118586.755482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165504 00000100:00100000:2.0:1787118586.755498:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787118586.755504:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165504:12345-0@lo:501: 00000100:00100000:2.0:1787118586.755881:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165504:12345-0@lo:501: Request processed in 375us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.755887:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787118586.755963:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165504:0@lo:501: 00000100:00100000:3.0:1787118586.755990:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165632:0@lo:503: 00000100:00100000:3.0:1787118586.756031:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.756055:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.756160:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165632 00000100:00100000:2.0:1787118586.756165:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165632 00000100:00100000:2.0:1787118586.756182:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787118586.756187:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165632:12345-0@lo:503: 00000100:00100000:2.0:1787118586.756387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165632:12345-0@lo:503: Request processed in 198us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.756393:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787118586.766895:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165632:0@lo:503: 00000040:00080000:3.0:1787118586.767420:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787118586.767498:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165760:0@lo:502: 00000100:00100000:3.0:1787118586.767574:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.767991:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:1.0:1787118586.770822:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165760 00000100:00100000:1.0:1787118586.770837:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165760 00000100:00100000:1.0:1787118586.770893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787118586.770902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165760:12345-0@lo:502: 00000100:00100000:1.0:1787118586.771174:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165760:12345-0@lo:502: Request processed in 271us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118586.771181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787118586.771364:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165760:0@lo:502: 00000040:00080000:3.0:1787118586.771798:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787118586.771855:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787118586.771888:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787118586.771933:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787118586.771973:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787118586.772001:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787118586.772033:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165888:0@lo:502: 00000100:00100000:3.0:1787118586.772079:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118586.772114:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886000 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.772187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566165888 00000100:00100000:0.0:1787118586.772192:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566165888 00000100:00100000:0.0:1787118586.772225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787118586.772232:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165888:12345-0@lo:502: 00000100:00100000:0.0:1787118586.772393:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566165888:12345-0@lo:502: Request processed in 161us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.772400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787118586.772529:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566165888:0@lo:502: 00000040:00080000:3.0:1787118586.772710:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787118586.772719:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787118586.775987:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787118586.775997:0:6719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787118586.776005:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118586.776007:0:6719:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787118586.776013:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787118586.776028:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff961346510000) 00000020:00000080:3.0:1787118586.776048:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787118586.776053:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787118586.776127:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961375697800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787118586.776135:0:6719:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787118586.776141:0:6719:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa534e3c784f8389 00010000:00010000:2.0:1787118586.786983:0:6719:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787118586.787297:0:6719:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787118586.795337:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787118586.797926:0:6719:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787118586.806924:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787118586.807438:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787118586.810574:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787118586.810588:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118586.810595:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118586.810597:0:6719:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787118586.810601:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118586.810605:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118586.810606:0:6719:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787118586.810610:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787118586.810612:0:6719:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787118586.810670:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118586.810674:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118586.810675:0:6719:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787118586.810678:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787118586.810973:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787118586.810997:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787118586.811021:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811033:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118586.811042:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375697800 from 1 10000000:01000000:0.0:1787118586.811044:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118586.811079:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811087:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811110:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.811134:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166016:0@lo:101: 00000100:00100000:0.0:1787118586.811198:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.811245:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134bf023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.811270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166016 00000100:00100000:0.0:1787118586.811290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166016 00000100:00100000:0.0:1787118586.811328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787118586.811337:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:6700:x1873929566166016:12345-0@lo:101: 00010000:00010000:0.0:1787118586.811349:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118586.811360:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8390 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811382:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811392:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811400:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030800, rc 0) 00000100:00100000:0.0:1787118586.811436:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166016:12345-0@lo:101: Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.811443:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787118586.811909:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166016:0@lo:101: 00010000:00010000:0.0:1787118586.811924:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.811944:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.812036:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166144:0@lo:501: 00000100:00100000:0.0:1787118586.812066:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.812091:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134bf023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.813259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166144 00000100:00100000:0.0:1787118586.813267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166144 00000100:00100000:0.0:1787118586.813325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787118586.813334:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166144:12345-0@lo:501: 00000100:00100000:0.0:1787118586.816654:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166144:12345-0@lo:501: Request processed in 3312us (4578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.816668:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787118586.818089:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166144:0@lo:501: 00000100:00100000:0.0:1787118586.818150:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166272:0@lo:503: 00000100:00100000:0.0:1787118586.818220:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.818266:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134bf023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.818306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166272 00000100:00100000:0.0:1787118586.818312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166272 00000100:00100000:0.0:1787118586.818359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787118586.818368:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166272:12345-0@lo:503: 00000100:00100000:0.0:1787118586.820058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166272:12345-0@lo:503: Request processed in 1684us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.820072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787118586.823329:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166272:0@lo:503: 00000040:00080000:1.0:1787118586.823691:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787118586.823973:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166400:0@lo:502: 00000100:00100000:1.0:1787118586.824046:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.824134:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.825056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166400 00000100:00100000:2.0:1787118586.825065:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166400 00000100:00100000:2.0:1787118586.825143:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787118586.825153:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166400:12345-0@lo:502: 00000100:00100000:2.0:1787118586.825413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166400:12345-0@lo:502: Request processed in 261us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.825422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787118586.825519:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166400:0@lo:502: 00000040:00080000:1.0:1787118586.825838:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787118586.825904:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787118586.825934:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166528:0@lo:502: 00000100:00100000:1.0:1787118586.825977:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.826340:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118586.826413:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166528 00000100:00100000:3.0:1787118586.826420:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166528 00000100:00100000:3.0:1787118586.826450:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787118586.826458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166528:12345-0@lo:502: 00000100:00100000:3.0:1787118586.826773:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166528:12345-0@lo:502: Request processed in 314us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118586.826791:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787118586.827024:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166528:0@lo:502: 00000040:00080000:1.0:1787118586.827135:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787118586.827147:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787118586.827700:0:6723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118586.827708:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118586.827717:0:6723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787118586.827897:0:6723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961375697800 00000020:00000080:3.0:1787118586.827900:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787118586.827925:0:6723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118586.827929:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118586.827930:0:6723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787118586.827933:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787118586.828048:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787118586.828068:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787118586.828088:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.828099:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118586.828136:0:6700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787118586.828139:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff961375697800 10000000:01000000:1.0:1787118586.828142:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff961375697800 10000000:01000000:1.0:1787118586.828146:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787118586.828151:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961375697800 from 1 10000000:01000000:1.0:1787118586.828154:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787118586.828182:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.828190:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.828200:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118586.828228:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166656:0@lo:101: 00000100:00100000:1.0:1787118586.828286:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.828330:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118586.828413:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166656 00000100:00100000:3.0:1787118586.828420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166656 00000100:00100000:3.0:1787118586.828463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787118586.828573:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566166656:12345-0@lo:101: 00010000:00010000:3.0:1787118586.828585:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118586.828597:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f839e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.828618:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f839e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.828628:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f839e expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118586.828636:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9613414b0e00, rc 0) 00000100:00100000:3.0:1787118586.828683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566166656:12345-0@lo:101: Request processed in 113us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118586.828773:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166656:0@lo:101: 00010000:00010000:1.0:1787118586.828798:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.828807:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118586.828881:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166784:0@lo:501: 00000100:00100000:1.0:1787118586.828906:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.828917:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.829103:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166784 00000100:00100000:0.0:1787118586.829117:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166784 00000100:00100000:3.0:1787118586.829240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787118586.829361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787118586.829370:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566166784:12345-0@lo:501: 00000100:00100000:0.0:1787118586.829602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566166784:12345-0@lo:501: Request processed in 233us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.829609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787118586.829671:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166784:0@lo:501: 00000100:00100000:1.0:1787118586.829699:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166912:0@lo:503: 00000100:00100000:1.0:1787118586.829771:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.830116:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.830188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566166912 00000100:00100000:2.0:1787118586.830193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566166912 00000100:00100000:2.0:1787118586.830219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787118586.830225:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566166912:12345-0@lo:503: 00000100:00100000:2.0:1787118586.830395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566166912:12345-0@lo:503: Request processed in 169us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.830402:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787118586.830485:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566166912:0@lo:503: 00000040:00080000:1.0:1787118586.830949:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787118586.831017:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167040:0@lo:502: 00000100:00100000:1.0:1787118586.831051:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.831072:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.831165:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167040 00000100:00100000:2.0:1787118586.831170:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167040 00000100:00100000:2.0:1787118586.831192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787118586.831198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566167040:12345-0@lo:502: 00000100:00100000:2.0:1787118586.831353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566167040:12345-0@lo:502: Request processed in 154us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.831360:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787118586.831436:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167040:0@lo:502: 00000040:00080000:1.0:1787118586.831922:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787118586.831985:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787118586.832017:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787118586.832062:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787118586.832098:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787118586.832145:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787118586.832182:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787118586.832213:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787118586.832270:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787118586.832321:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787118586.832355:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787118586.832406:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787118586.832441:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787118586.832598:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787118586.832666:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787118586.832708:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787118586.832852:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787118586.832910:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787118586.832948:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787118586.832979:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787118586.833023:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787118586.833059:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787118586.833095:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787118586.833146:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787118586.833185:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787118586.833221:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787118586.833295:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787118586.833337:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787118586.833378:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167168:0@lo:502: 00000100:00100000:1.0:1787118586.833445:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118586.833605:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167168 00000100:00100000:2.0:1787118586.833612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167168 00000100:00100000:2.0:1787118586.833648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787118586.833657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566167168:12345-0@lo:502: 00000100:00100000:1.0:1787118586.835970:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.836527:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566167168:12345-0@lo:502: Request processed in 2867us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118586.836539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787118586.836645:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167168:0@lo:502: 00000040:00080000:1.0:1787118586.837105:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787118586.837132:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787118586.838598:0:6724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787118586.838613:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9613465119c0) 00000020:00000080:3.0:1787118586.838690:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787118586.839171:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961375697800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787118586.839176:0:6724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961375697800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787118586.839179:0:6724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961375697800 3 00010000:00080000:3.0:1787118586.839214:0:6724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96137f88f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.110@tcp at head 00010000:00010000:3.0:1787118586.842535:0:6724:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787118586.842657:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787118586.842694:0:6724:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787118586.842706:0:6724:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa534e3c784f83b3 00000100:00080000:3.0:1787118586.842716:0:6724:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787118586.842758:0:6724:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96137f88f000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118586.842862:0:6724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137abb4000 x1873929566167296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787118586.842883:0:6724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787118586.843056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787118586.843060:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787118586.843085:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566167424:0@lo:400: 00000100:00100000:0.0:1787118586.843152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.843199:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118586.843205:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566167552:0@lo:400: 00000100:00100000:0.0:1787118586.843235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118586.843267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167424 00000100:00100000:0.0:1787118586.843284:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167424 00000100:00100000:0.0:1787118586.843319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787118586.843328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3298:x1873929566167424:12345-0@lo:400: 00000100:00100000:0.0:1787118586.843373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3298:x1873929566167424:12345-0@lo:400: Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.843381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787118586.843418:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566167424:0@lo:400: 00000100:00100000:2.0:1787118586.843575:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566167296:0@lo:38: 00000100:00100000:2.0:1787118586.843609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118586.843638:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167552 00000100:00100000:2.0:1787118586.843642:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167552 00000100:00100000:2.0:1787118586.843901:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167296 00000100:00100000:2.0:1787118586.843906:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167296 00000100:00100000:0.0:1787118586.847927:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118586.847945:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566167552:12345-0@lo:400: 00000100:00100000:0.0:1787118586.848040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566167552:12345-0@lo:400: Request processed in 101us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.848059:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118586.848085:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118586.848089:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566167296:12345-0@lo:38: 00010000:00080000:0.0:1787118586.848111:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1787118586.848144:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa534e3c784f83ba 00000004:00100000:0.0:1787118586.848158:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787118586.848185:0:5843:0:(import.c:65:import_set_state_nolock()) ffff96136e4d8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118586.848234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873929566167296:12345-0@lo:38: Request processed in 143us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.848240:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787118586.848452:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96137abac380 x1873929566167552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118586.848466:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566167552:0@lo:400: 00000040:00080000:3.0:1787118586.848606:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1787118586.848907:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96137abb4000 x1873929566167296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118586.848916:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787118586.848923:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787118586.848929:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787118586.848934:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787118586.848936:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96137f88f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787118586.848942:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566167296:0@lo:38: 00000020:01000000:2.0:1787118586.850188:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787118586.850221:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787118586.850237:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.850259:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787118586.850335:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787118586.850337:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118586.850338:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118586.850339:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118586.850340:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118586.850342:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118586.850343:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118586.850345:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787118586.850347:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787118586.850348:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118586.850349:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787118586.850353:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787118586.850356:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787118586.850357:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118586.850358:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118586.850359:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118586.850360:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118586.850361:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118586.850363:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118586.850364:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787118586.850365:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787118586.850366:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118586.850367:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787118586.850390:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787118586.850406:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167680:0@lo:253: 00000100:00100000:2.0:1787118586.850460:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118586.850499:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787118586.850519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167680 00000100:00100000:2.0:1787118586.850525:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167680 00000100:00100000:2.0:1787118586.850561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787118586.850570:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:6700:x1873929566167680:12345-0@lo:253: 20000000:01000000:2.0:1787118586.850601:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787118586.850614:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787118586.920323:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787118586.920341:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787118586.921542:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787118586.921550:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787118586.921571:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.921590:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.921598:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.921635:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118586.921648:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 13 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118586.921661:0:5857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566167808:0@lo:104: 00000100:00100000:1.0:1787118586.921757:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118586.921811:0:5857:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343c343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118586.921891:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167808 00000100:00100000:0.0:1787118586.921899:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167808 00000100:00100000:0.0:1787118586.921945:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118586.921955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566167808:12345-0@lo:104: 00010000:00010000:0.0:1787118586.921968:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922018:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787118586.922025:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566167808:12345-0@lo:104: Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.922031:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118586.922064:0:5857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566167808:0@lo:104: 00010000:00010000:0.0:1787118586.922081:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922235:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118586.922243:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922251:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613414b0200 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118586.922255:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922263:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118586.922270:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118586.922286:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118586.922322:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922329:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787118586.922378:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566167936:0@lo:103: 00000100:00100000:1.0:1787118586.922411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787118586.922451:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922459:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff9613414b0200/0xaa534e3c784f8319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8320 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118586.922475:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118586.922477:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118586.922478:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118586.922538:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566167936 00000100:00100000:0.0:1787118586.922553:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566167936 00010000:00010000:0.0:1787118586.922570:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 14 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118586.922602:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118586.922609:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350045c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3300:x1873929566167936:12345-0@lo:103: 00010000:00010000:0.0:1787118586.922619:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118586.922623:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 14 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922633:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 14 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922646:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042000/0xaa534e3c784f8320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8319 expref: 14 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922657:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922665:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787118586.922676:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002020980s 00010000:00010000:0.0:1787118586.922681:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922686:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922693:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922710:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922716:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118586.922761:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922770:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922781:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.922790:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118586.924257:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350045c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3300:x1873929566167936:12345-0@lo:103: Request processed in 1640us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.924269:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787118586.924341:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.924351:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118586.924357:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042200/0xaa534e3c784f83c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118586.924480:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566167936:0@lo:103: 00000100:00100000:0.0:1787118586.930592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:6700:x1873929566167680:12345-0@lo:253: Request processed in 80013us (80122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118586.930605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787118586.930879:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:6700:1873929566167680:0@lo:253: 10000000:01000000:2.0:1787118586.930900:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787118586.930903:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787118586.930905:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118586.930906:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118586.930907:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118586.930908:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118586.930910:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118586.930911:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118586.930913:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787118586.930914:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787118586.930916:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118586.930918:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787118586.930933:0:6700:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787118586.936703:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118586.937032:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787118586.937262:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118586.937426:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787118586.937623:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118586.938126:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787118586.939078:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787118587.176491:0:6700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787118587.176498:0:6700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787118587.176531:0:6700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787118587.176594:0:6700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787118587.176607:0:6700:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787118587.176632:0:6700:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787118587.669638:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118588.683551:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118589.705904:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118590.730864:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118591.754858:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787118592.330788:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787118592.330797:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961347c3c800 from 21 10000000:01000000:0.0:1787118592.330802:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787118592.330849:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.330861:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.330871:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118592.330896:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168064:0@lo:101: 00000100:00100000:0.0:1787118592.330972:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.331040:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342dc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.331269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168064 00000100:00100000:0.0:1787118592.331569:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168064 00000100:00100000:0.0:1787118592.331629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787118592.331639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566168064:12345-0@lo:101: 00010000:00010000:0.0:1787118592.331652:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118592.331665:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f83c8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.331688:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.331700:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.331708:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031a00, rc 0) 00000100:00100000:0.0:1787118592.331792:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168064:12345-0@lo:101: Request processed in 153us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.331801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787118592.331843:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566168320:0@lo:400: 00000100:00100000:0.0:1787118592.331881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.331971:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168064:0@lo:101: 00010000:00010000:0.0:1787118592.331990:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.332002:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118592.332053:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168448:0@lo:501: 00000100:00100000:0.0:1787118592.332215:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118592.333709:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566168192:0@lo:400: 00000100:00100000:2.0:1787118592.333939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118592.333989:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168448 00000100:00100000:2.0:1787118592.333996:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168448 00000100:00100000:2.0:1787118592.334035:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787118592.334043:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168448:12345-0@lo:501: 00000100:00100000:2.0:1787118592.334583:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168448:12345-0@lo:501: Request processed in 540us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118592.334592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787118592.334626:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168320 00000100:00100000:2.0:1787118592.334631:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168320 00000100:00100000:2.0:1787118592.334666:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168192 00000100:00100000:2.0:1787118592.334669:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168192 00000100:00100000:2.0:1787118592.334681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787118592.334687:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566168320:12345-0@lo:400: 00000100:00100000:2.0:1787118592.334745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566168320:12345-0@lo:400: Request processed in 58us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118592.334757:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787118592.334769:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118592.334775:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566168192:12345-0@lo:400: 00000100:00100000:2.0:1787118592.334809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566168192:12345-0@lo:400: Request processed in 33us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118592.334815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787118592.334833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787118592.334860:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abae680 x1873929566168320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118592.334938:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566168320:0@lo:400: 00010000:00080000:2.0:1787118592.334970:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abad500 x1873929566168192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118592.334978:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566168192:0@lo:400: 00000100:00100000:0.0:1787118592.340051:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342dc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.341151:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168448:0@lo:501: 00000100:00100000:0.0:1787118592.341284:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168576:0@lo:503: 00000100:00100000:0.0:1787118592.341356:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.341395:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168576 00000100:00100000:0.0:1787118592.341402:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168576 00000100:00100000:0.0:1787118592.341448:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787118592.341459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168576:12345-0@lo:503: 00000100:00100000:0.0:1787118592.342333:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168576:12345-0@lo:503: Request processed in 874us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.342341:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787118592.342408:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342dc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.342431:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168576:0@lo:503: 00000100:00100000:0.0:1787118592.342895:0:7001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7001:1873929566168704:0@lo:502: 00000100:00100000:0.0:1787118592.343099:0:7001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.343134:0:7001:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342dc3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.343168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168704 00000100:00100000:3.0:1787118592.343191:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168704 00000100:00100000:3.0:1787118592.343224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787118592.343233:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7001:x1873929566168704:12345-0@lo:502: 00000100:00100000:3.0:1787118592.343491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7001:x1873929566168704:12345-0@lo:502: Request processed in 259us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.343505:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787118592.343515:0:7001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7001:1873929566168704:0@lo:502: 00000100:00100000:0.0:1787118592.343561:0:7001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7001:1873929566168832:0@lo:502: 00000100:00100000:0.0:1787118592.343593:0:7001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.343614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168832 00000100:00100000:0.0:1787118592.343617:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168832 00000100:00100000:0.0:1787118592.343648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787118592.343655:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7001:x1873929566168832:12345-0@lo:502: 00000100:00100000:0.0:1787118592.343802:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7001:x1873929566168832:12345-0@lo:502: Request processed in 147us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.343809:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787118592.343845:0:7001:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342dc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.343858:0:7001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7001:1873929566168832:0@lo:502: 00000040:00080000:0.0:1787118592.343877:0:7001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787118592.344088:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787118592.344109:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118592.344120:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.344131:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118592.344140:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787118592.344142:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff961347c3c800 from 4 10000000:01000000:3.0:1787118592.344145:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787118592.344171:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.344178:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.344187:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118592.344200:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168960:0@lo:101: 00000100:00100000:3.0:1787118592.344228:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.344259:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.345893:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566168960 00000100:00100000:0.0:1787118592.345966:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566168960 00000100:00100000:0.0:1787118592.346166:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787118592.346175:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566168960:12345-0@lo:101: 00010000:00010000:0.0:1787118592.346187:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118592.346205:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f83d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.346231:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.346265:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118592.346274:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030c00, rc 0) 00000100:00100000:0.0:1787118592.346339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566168960:12345-0@lo:101: Request processed in 165us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.346346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787118592.346403:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566168960:0@lo:101: 00010000:00010000:3.0:1787118592.346419:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.346428:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118592.346497:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169088:0@lo:256: 00000100:00100000:3.0:1787118592.346532:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.346571:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118592.346625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169088 00000100:00100000:0.0:1787118592.346809:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169088 00000100:00100000:0.0:1787118592.346883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787118592.346890:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566169088:12345-0@lo:256: 20000000:01000000:0.0:1787118592.346904:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787118592.346920:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787118592.346923:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787118592.347003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566169088:12345-0@lo:256: Request processed in 112us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.347009:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787118592.347175:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169088:0@lo:256: 10000000:01000000:3.0:1787118592.347215:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787118592.347221:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347230:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118592.347250:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787118592.347252:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787118592.347255:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787118592.347273:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347280:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347287:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118592.347309:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169216:0@lo:101: 00000100:00100000:3.0:1787118592.347332:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.347356:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.347368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169216 00000100:00100000:3.0:1787118592.347378:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169216 00000100:00100000:3.0:1787118592.347401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118592.347407:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566169216:12345-0@lo:101: 00010000:00010000:3.0:1787118592.347415:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118592.347424:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f83e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347440:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347449:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347457:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d200, rc 0) 00000100:00100000:3.0:1787118592.347484:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169216:12345-0@lo:101: Request processed in 77us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.347489:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118592.347518:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169216:0@lo:101: 00010000:00010000:3.0:1787118592.347528:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118592.347536:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118592.347579:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169344:0@lo:501: 00000100:00100000:3.0:1787118592.347603:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.347615:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.347625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169344 00000100:00100000:3.0:1787118592.347629:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169344 00000100:00100000:3.0:1787118592.347657:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787118592.347662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169344:12345-0@lo:501: 00000100:00100000:3.0:1787118592.348216:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169344:12345-0@lo:501: Request processed in 552us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.348223:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787118592.348267:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169344:0@lo:501: 00000100:00100000:3.0:1787118592.348301:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169472:0@lo:503: 00000100:00100000:3.0:1787118592.348334:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.348346:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.348356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169472 00000100:00100000:3.0:1787118592.348359:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169472 00000100:00100000:3.0:1787118592.348375:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787118592.348380:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169472:12345-0@lo:503: 00000100:00100000:3.0:1787118592.348642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169472:12345-0@lo:503: Request processed in 261us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.348649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787118592.348690:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169472:0@lo:503: 00000100:00100000:0.0:1787118592.355047:0:7002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7002:1873929566169600:0@lo:502: 00000100:00100000:0.0:1787118592.355138:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118592.355177:0:7002:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.355639:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169600 00000100:00100000:3.0:1787118592.355647:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169600 00000100:00100000:3.0:1787118592.355699:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787118592.355716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7002:x1873929566169600:12345-0@lo:502: 00000100:00100000:3.0:1787118592.356020:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7002:x1873929566169600:12345-0@lo:502: Request processed in 305us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.356029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787118592.356259:0:7002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7002:1873929566169600:0@lo:502: 00000020:01000000:1.0:1787118592.356289:0:7002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787118592.356306:0:7002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787118592.356313:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118592.356315:0:7002:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787118592.356321:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787118592.356325:0:7002:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.110@tcp to nid 0x20000c0a8cb6e (192.168.203.110@tcp) 00000020:01000000:1.0:1787118592.356346:0:7002:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787118592.356349:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787118592.356363:0:7002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96137abc8000) 00000020:00000080:1.0:1787118592.356381:0:7002:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787118592.356386:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787118592.356456:0:7002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787118592.356462:0:7002:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787118592.356469:0:7002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f83f9 00010000:00080000:1.0:1787118592.356496:0:7002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96137f860000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:1.0:1787118592.356750:0:7002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787118592.412659:0:7002:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787118592.412679:0:7002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787118592.413512:0:7002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787118592.413682:0:7002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787118592.413866:0:7002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787118592.413921:0:7002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787118592.414620:0:7005:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118592.414625:0:7005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787118592.418534:0:7002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787118592.418547:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787118592.418579:0:7002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787118592.418598:0:7002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f8400 00000100:00080000:1.0:1787118592.418608:0:7002:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787118592.418613:0:7002:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96137f860000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:1.0:1787118592.418642:0:7002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9613476c8e00 x1873929566169728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787118592.418668:0:7002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787118592.418789:0:7002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118592.418792:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118592.418794:0:7002:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787118592.418797:0:7002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118592.418801:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118592.418802:0:7002:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787118592.418805:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787118592.418806:0:7002:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787118592.418830:0:7002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7002:1873929566169856:0@lo:502: 00000100:00100000:1.0:1787118592.418895:0:7002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118592.418935:0:7002:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118592.418952:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566169728:0@lo:8: 00000100:00100000:1.0:1787118592.418986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118592.419019:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169856 00000100:00100000:1.0:1787118592.419025:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169856 00000100:00100000:1.0:1787118592.419054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787118592.419062:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7002:x1873929566169856:12345-0@lo:502: 00000100:00100000:3.0:1787118592.419246:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169728 00000100:00100000:3.0:1787118592.419251:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169728 00000100:00100000:3.0:1787118592.419282:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118592.419287:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1873929566169728:12345-0@lo:8: 00010000:00080000:3.0:1787118592.419318:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1787118592.419340:0:6703:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f8407 00002000:00100000:3.0:1787118592.419372:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96137f88e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113903 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787118592.419376:0:6703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787118592.419379:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787118592.419487:0:6703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787118592.419617:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787118592.419638:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96137f88f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118592.419686:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1873929566169728:12345-0@lo:8: Request processed in 398us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.419693:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787118592.420165:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7002:x1873929566169856:12345-0@lo:502: Request processed in 1101us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118592.420174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787118592.420229:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9613476c8e00 x1873929566169728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787118602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118592.420249:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787118592.420255:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787118592.420262:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787118592.420267:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787118592.420275:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96137f860000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787118592.420302:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787118592.420308:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566169728:0@lo:8: 00000100:00100000:1.0:1787118592.420342:0:7002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7002:1873929566169856:0@lo:502: 00000020:01000000:1.0:1787118592.420365:0:7002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118592.420370:0:7002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118592.420372:0:7002:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787118592.420376:0:7002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787118592.420483:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787118592.420499:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787118592.420508:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420518:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118592.420528:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787118592.420530:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff961346264d40 from 1 10000000:01000000:1.0:1787118592.420533:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787118592.420557:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420565:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420574:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118592.420588:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169984:0@lo:101: 00000100:00100000:1.0:1787118592.420617:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118592.420643:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118592.420658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566169984 00000100:00100000:1.0:1787118592.420662:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566169984 00000100:00100000:1.0:1787118592.420685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787118592.420692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566169984:12345-0@lo:101: 00010000:00010000:1.0:1787118592.420832:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118592.420845:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f840e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420866:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420876:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420884:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042200, rc 0) 00000100:00100000:1.0:1787118592.420910:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566169984:12345-0@lo:101: Request processed in 219us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118592.420915:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787118592.420947:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566169984:0@lo:101: 00010000:00010000:1.0:1787118592.420958:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.420967:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118592.421004:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566170112:0@lo:501: 00000100:00100000:1.0:1787118592.421028:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118592.421040:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118592.421056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170112 00000100:00100000:1.0:1787118592.421059:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170112 00000100:00100000:1.0:1787118592.421860:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118592.421868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566170112:12345-0@lo:501: 00000100:00100000:1.0:1787118592.422807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566170112:12345-0@lo:501: Request processed in 936us (1774us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118592.422817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118592.422867:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566170112:0@lo:501: 10000000:01000000:1.0:1787118592.422902:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787118592.422909:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118592.422919:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787118592.422944:0:7005:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787118592.423056:0:7005:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 171580333581ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787118592.550936:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787118592.551154:0:7006:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787118592.551183:0:7006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170368:0@lo:7: 00000100:00100000:3.0:1787118592.551257:0:7006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.551319:0:7006:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.551340:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566170240:0@lo:13: 00000100:00100000:3.0:1787118592.551365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.551399:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170368 00000100:00100000:3.0:1787118592.551406:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170368 00000100:00100000:3.0:1787118592.551453:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787118592.551463:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7006:x1873929566170368:12345-0@lo:7: 00000100:00100000:0.0:1787118592.552809:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170240 00000100:00100000:0.0:1787118592.552817:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170240 00000100:00100000:0.0:1787118592.552857:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118592.552866:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566170240:12345-0@lo:13: 00002000:00000024:0.0:1787118592.552889:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787118592.552957:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566170240:12345-0@lo:13: Request processed in 91us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118592.552964:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787118592.553785:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118592.556852:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb5f80 x1873929566170240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118592.556879:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566170240:0@lo:13: 00002000:00080000:3.0:1787118592.557919:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787118592.557925:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787118592.558057:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7006:x1873929566170368:12345-0@lo:7: Request processed in 6594us (6798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.558143:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787118592.563262:0:7006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb7100 x1873929566170368/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787118608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118592.563280:0:7006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170368:0@lo:7: 00000004:00080000:2.0:1787118592.563375:0:7006:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787118592.568212:0:7006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170496:0@lo:5: 00000100:00100000:3.0:1787118592.568288:0:7006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.568355:0:7006:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118592.568489:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170496 00000100:00100000:2.0:1787118592.568498:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170496 00000100:00100000:2.0:1787118592.568550:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787118592.568558:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7006:x1873929566170496:12345-0@lo:5: 00002000:00080000:2.0:1787118592.568584:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787118592.568588:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787118592.568944:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7006:x1873929566170496:12345-0@lo:5: Request processed in 386us (655us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787118592.568952:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787118592.570859:0:7006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb6a00 x1873929566170496/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118592.570877:0:7006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170496:0@lo:5: 00000004:00080000:3.0:1787118592.570889:0:7006:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787118592.570926:0:7006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170624:0@lo:700: 00000100:00100000:3.0:1787118592.570970:0:7006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.571013:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170624 00000100:00100000:3.0:1787118592.571018:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170624 00000100:00100000:3.0:1787118592.571057:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118592.571065:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7006:x1873929566170624:12345-0@lo:700: 00000100:00100000:3.0:1787118592.571109:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1873929566170752:0@lo:700: 00000100:00100000:3.0:1787118592.571138:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.571174:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118592.571188:0:7006:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118592.571257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170752 00000100:00100000:2.0:1787118592.571261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170752 00000100:00100000:2.0:1787118592.571302:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118592.571309:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1873929566170752:12345-0@lo:700: 40000000:02000000:3.0:1787118592.652945:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787118592.664164:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1873929566170752:12345-0@lo:700: Request processed in 92846us (93015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118592.664178:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787118592.664307:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb6680 x1873929566170752/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787118608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118592.664323:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1873929566170752:0@lo:700: 40000000:02000000:3.0:1787118592.664336:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787118592.766804:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7006:x1873929566170624:12345-0@lo:700: Request processed in 195731us (195824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118592.766834:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787118592.770549:0:7006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb4a80 x1873929566170624/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787118608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118592.770567:0:7006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170624:0@lo:700: 00000001:00080000:1.0:1787118592.771826:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787118592.771851:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787118592.785486:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1787118592.821433:0:7006:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787118592.825980:0:7006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170880:0@lo:5: 00000100:00100000:3.0:1787118592.826050:0:7006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118592.826111:0:7006:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351af7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118592.826169:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566170880 00000100:00100000:1.0:1787118592.826177:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566170880 00000100:00100000:1.0:1787118592.826243:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787118592.826253:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7006:x1873929566170880:12345-0@lo:5: 00002000:00080000:1.0:1787118592.836685:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787118592.836704:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787118592.843407:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7006:x1873929566170880:12345-0@lo:5: Request processed in 17145us (17346us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787118592.843423:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787118592.844967:0:7006:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb6680 x1873929566170880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118592.844985:0:7006:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787118592.845002:0:7006:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96137abb6680 x1873929566170880/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118608 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118592.845014:0:7006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7006:1873929566170880:0@lo:5: 00000004:00080000:3.0:1787118592.845027:0:7006:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787118593.812556:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787118593.865386:0:7075:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787118594.825892:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118595.858992:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118596.874022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118597.459036:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566171008:0@lo:400: 00000100:00100000:0.0:1787118597.459106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118597.459158:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118597.459164:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566171136:0@lo:400: 00000100:00100000:0.0:1787118597.459190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118597.459233:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566171264:0@lo:400: 00000100:00100000:0.0:1787118597.459267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118597.459286:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118597.459291:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566171392:0@lo:400: 00000100:00100000:0.0:1787118597.459316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118597.459517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171008 00000100:00100000:0.0:1787118597.459524:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171008 00000100:00100000:0.0:1787118597.459567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787118597.459576:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3300:x1873929566171008:12345-0@lo:400: 00000100:00100000:0.0:1787118597.459643:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3300:x1873929566171008:12345-0@lo:400: Request processed in 67us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118597.459650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787118597.459866:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171136 00000100:00100000:0.0:1787118597.459870:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171136 00000100:00100000:0.0:1787118597.459920:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171264 00000100:00100000:0.0:1787118597.459923:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171264 00000100:00100000:0.0:1787118597.459949:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118597.459955:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566171136:12345-0@lo:400: 00000100:00100000:0.0:1787118597.459988:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566171136:12345-0@lo:400: Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118597.459994:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118597.460005:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787118597.460011:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566171264:12345-0@lo:400: 00000100:00100000:0.0:1787118597.460043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566171264:12345-0@lo:400: Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118597.460049:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787118597.460072:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118597.460097:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abae300 x1873929566171264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118597.460110:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566171264:0@lo:400: 00010000:00080000:0.0:1787118597.460136:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abaf800 x1873929566171136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118597.460145:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566171136:0@lo:400: 00000100:00100000:0.0:1787118597.460154:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566171008:0@lo:400: 00000100:00100000:3.0:1787118597.460286:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171392 00000100:00100000:3.0:1787118597.460290:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171392 00000100:00100000:3.0:1787118597.460343:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118597.460350:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566171392:12345-0@lo:400: 00000100:00100000:3.0:1787118597.460389:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566171392:12345-0@lo:400: Request processed in 40us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118597.460394:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787118597.460419:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abad180 x1873929566171392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118597.460429:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566171392:0@lo:400: 00000100:00080000:0.0:1787118597.462864:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787118597.897853:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118597.971776:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566171520:0@lo:13: 00000100:00100000:3.0:1787118597.972086:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118597.973010:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171520 00000100:00100000:0.0:1787118597.973020:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171520 00000100:00100000:0.0:1787118597.973063:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118597.973073:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566171520:12345-0@lo:13: 00002000:00000024:0.0:1787118597.973107:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118597.973170:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566171520:12345-0@lo:13: Request processed in 99us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118597.973189:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787118597.973245:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb6a00 x1873929566171520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118597.973266:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566171520:0@lo:13: 00000001:00080000:1.0:1787118598.131208:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787118598.923784:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118599.951161:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118600.970347:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118601.993936:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118602.570024:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566171648:0@lo:400: 00000100:00100000:1.0:1787118602.570028:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566171776:0@lo:400: 00000100:00100000:2.0:1787118602.570109:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566172032:0@lo:400: 00000100:00100000:0.0:1787118602.571148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118602.571238:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566171904:0@lo:400: 00000100:00100000:0.0:1787118602.571271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118602.571307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171904 00000100:00100000:0.0:1787118602.571313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171904 00000100:00100000:0.0:1787118602.571361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787118602.571370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566171904:12345-0@lo:400: 00000100:00100000:0.0:1787118602.571418:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566171904:12345-0@lo:400: Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118602.571425:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787118602.571445:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118602.571473:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9613476cb100 x1873929566171904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118602.571485:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566171904:0@lo:400: 00000100:00100000:3.0:1787118602.571590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171648 00000100:00100000:3.0:1787118602.571595:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171648 00000100:00100000:3.0:1787118602.571627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787118602.571634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3301:x1873929566171648:12345-0@lo:400: 00000100:00100000:3.0:1787118602.571671:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3301:x1873929566171648:12345-0@lo:400: Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118602.571677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787118602.571755:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566171648:0@lo:400: 00000100:00100000:1.0:1787118602.573120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118602.574018:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566171776 00000100:00100000:0.0:1787118602.574037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566171776 00000100:00100000:0.0:1787118602.574084:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118602.574092:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566171776:12345-0@lo:400: 00000100:00100000:0.0:1787118602.574165:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566171776:12345-0@lo:400: Request processed in 73us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118602.574183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787118602.574222:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9613476c8e00 x1873929566171776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118602.574235:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566171776:0@lo:400: 00000100:00100000:2.0:1787118602.574372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118602.577266:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172032 00000100:00100000:1.0:1787118602.577278:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172032 00000100:00080000:0.0:1787118602.577322:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118602.577355:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118602.577366:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566172032:12345-0@lo:400: 00000100:00100000:1.0:1787118602.577460:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566172032:12345-0@lo:400: Request processed in 96us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118602.577469:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787118602.577523:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9613476cb480 x1873929566172032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118602.577535:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787118602.577554:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566172032:0@lo:400: 00010000:00010000:0.0:1787118603.018141:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118603.082452:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118603.082477:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566172160:0@lo:13: 00000100:00100000:3.0:1787118603.082545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118603.082773:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172160 00000100:00100000:0.0:1787118603.082782:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172160 00000100:00100000:0.0:1787118603.082831:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118603.082840:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566172160:12345-0@lo:13: 00002000:00000024:0.0:1787118603.082873:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118603.082922:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566172160:12345-0@lo:13: Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118603.082928:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787118603.082964:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abb6300 x1873929566172160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118603.082982:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566172160:0@lo:13: 00010000:00010000:3.0:1787118604.041871:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118605.068162:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787118605.969238:0:7629:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787118605.969242:0:7629:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787118605.969383:0:7629:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96137a707800 00000020:01000004:3.0:1787118605.969400:0:7629:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787118605.969414:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787118605.969436:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96137a6b4d40) 00000020:00000080:3.0:1787118605.969460:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787118606.029382:0:7629:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787118606.032440:0:7629:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787118606.070369:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787118606.082649:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787118606.082686:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787118606.082785:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787118606.082813:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787118606.083172:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787118606.083184:0:7629:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787118606.083194:0:7629:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa534e3c784f8423 00000020:01000004:3.0:1787118606.083201:0:7629:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787118606.083225:0:7629:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.110@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787118606.083228:0:7629:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787118606.083234:0:7629:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787118606.083256:0:7629:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787118606.083260:0:7629:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:3.0:1787118606.089938:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787118606.128128:0:7629:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787118606.128178:0:7629:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.110@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787118606.128182:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787118606.128184:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118606.128185:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118606.128187:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118606.128188:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118606.128189:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118606.128191:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118606.128192:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787118606.128194:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787118606.128196:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118606.128197:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118606.128204:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787118606.128206:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787118606.128207:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118606.128208:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118606.128209:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118606.128210:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118606.128211:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118606.128212:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118606.128213:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787118606.128214:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787118606.128215:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118606.128216:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118606.128240:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787118606.128257:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566172288:0@lo:253: 00000100:00100000:2.0:1787118606.128321:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.128381:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118606.128553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172288 00000100:00100000:0.0:1787118606.128561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172288 00000100:00100000:0.0:1787118606.128614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787118606.128623:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:7629:x1873929566172288:12345-0@lo:253: 20000000:01000000:0.0:1787118606.128651:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787118606.128661:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787118606.128666:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787118606.128669:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787118606.136993:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787118606.137313:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787118606.137335:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787118606.137387:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787118606.137396:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787118606.137427:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787118606.137476:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787118606.141385:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787118606.141423:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.110@tcp 20000000:01000000:1.0:1787118606.141426:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787118606.141466:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787118606.141475:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787118606.141525:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787118606.141533:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.110@tcp (null) (null) 00000040:00080000:1.0:1787118606.141565:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787118606.141575:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787118606.142699:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787118606.143249:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787118606.145347:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787118606.145376:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.110@tcp 20000000:01000000:1.0:1787118606.145378:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787118606.145415:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787118606.145423:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787118606.145453:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787118606.145461:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.110@tcp (null) (null) 00000040:00080000:1.0:1787118606.145488:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787118606.145497:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787118606.145536:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787118606.145571:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787118606.145586:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787118606.145589:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787118606.145595:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787118606.145596:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787118606.145599:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787118606.145985:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787118606.145988:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787118606.146024:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787118606.146027:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787118606.146514:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787118606.146843:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787118606.146880:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787118606.146963:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787118606.146975:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787118606.146977:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787118606.147606:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787118606.148078:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787118606.148136:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787118606.151489:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787118606.151546:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787118606.151678:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787118606.151693:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787118606.151695:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787118606.153824:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787118606.153906:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787118606.154517:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787118606.154916:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787118606.154973:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787118606.155005:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787118606.155019:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787118606.155022:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787118606.156040:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787118606.156119:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787118606.156171:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787118606.156762:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787118606.156808:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787118606.156886:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1787118606.156907:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787118606.157115:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157135:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157153:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f839e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157169:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157176:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157184:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.157192:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157292:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157310:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.157326:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172416:0@lo:104: 00000100:00100000:0.0:1787118606.157394:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118606.157445:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157453:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 16 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.157462:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172544:0@lo:104: 00010000:00010000:0.0:1787118606.157487:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157494:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 16 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.157502:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172672:0@lo:104: 00010000:00010000:0.0:1787118606.157522:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157530:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 16 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.157549:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172800:0@lo:104: 00010000:00010000:0.0:1787118606.157576:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.157584:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 16 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.157591:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172928:0@lo:104: 00000100:00100000:0.0:1787118606.157619:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.157807:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787118606.157825:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.157851:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.157860:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.157868:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.157879:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172416 00000100:00100000:1.0:1787118606.157886:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172416 00000100:00100000:1.0:1787118606.157915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172544 00000100:00100000:1.0:1787118606.157918:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172544 00000100:00100000:1.0:1787118606.157945:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172672 00000100:00100000:1.0:1787118606.157947:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172672 00000100:00100000:1.0:1787118606.157956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172800 00000100:00100000:1.0:1787118606.157958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172800 00000100:00100000:1.0:1787118606.157966:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566172928 00000100:00100000:1.0:1787118606.157968:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566172928 00000100:00100000:1.0:1787118606.157979:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118606.157987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613515e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:5836:x1873929566172416:12345-0@lo:104: 00010000:00010000:1.0:1787118606.157999:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158065:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118606.158072:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613515e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:5836:x1873929566172416:12345-0@lo:104: Request processed in 86us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.158081:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118606.158118:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118606.158124:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5836:x1873929566172544:12345-0@lo:104: 00010000:00010000:1.0:1787118606.158132:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158181:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787118606.158187:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:5836:x1873929566172544:12345-0@lo:104: Request processed in 64us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.158193:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118606.158205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118606.158211:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5836:x1873929566172672:12345-0@lo:104: 00010000:00010000:1.0:1787118606.158218:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158244:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787118606.158249:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:5836:x1873929566172672:12345-0@lo:104: Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.158255:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118606.158265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118606.158270:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:5836:x1873929566172800:12345-0@lo:104: 00010000:00010000:1.0:1787118606.158278:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158311:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787118606.158316:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:5836:x1873929566172800:12345-0@lo:104: Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.158323:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118606.158333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118606.158340:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5836:x1873929566172928:12345-0@lo:104: 00010000:00010000:1.0:1787118606.158347:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158372:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787118606.158376:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5836:x1873929566172928:12345-0@lo:104: Request processed in 38us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.158382:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787118606.158399:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787118606.158404:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158411:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.158415:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158422:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.158429:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.158434:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.158466:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158473:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.158489:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158495:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382042600/0xaa534e3c784f840e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8415 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158509:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787118606.158511:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158516:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.158519:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158526:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.158532:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.158537:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.158548:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158554:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.158559:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158576:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8c000/0xaa534e3c784f83e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158586:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787118606.158589:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158594:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.158597:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158604:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.158621:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.158626:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.158641:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158646:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.158660:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158667:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340030400/0xaa534e3c784f83c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158677:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118606.158685:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158691:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382043200 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.158694:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158701:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.158707:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.158746:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.158760:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158766:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.158771:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158778:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382043200/0xaa534e3c784f839e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83a5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158788:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118606.158791:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158797:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613414b0600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.158801:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158817:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.158823:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.158828:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.158840:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158846:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.158850:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158857:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff9613414b0600/0xaa534e3c784f8374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f837b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.158870:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118606.158872:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118606.158874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118606.158897:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173056:0@lo:103: 00000100:00100000:1.0:1787118606.158926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.158947:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173568:0@lo:103: 00000100:00100000:1.0:1787118606.158964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.158981:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787118606.158987:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173184:0@lo:103: 00000100:00100000:1.0:1787118606.159003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.159026:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566173312:0@lo:103: 00000100:00100000:1.0:1787118606.159054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.159066:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118606.159071:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566173440:0@lo:103: 00000100:00100000:1.0:1787118606.159087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.159110:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173056 00000100:00100000:1.0:1787118606.159114:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173056 00010000:00010000:1.0:1787118606.159132:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 17 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.159159:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173568 00000100:00100000:1.0:1787118606.159162:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173568 00010000:00010000:1.0:1787118606.159173:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 18 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.159183:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173184 00000100:00100000:1.0:1787118606.159186:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173184 00010000:00010000:1.0:1787118606.159194:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 19 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.159202:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173312 00000100:00100000:1.0:1787118606.159205:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173312 00010000:00010000:1.0:1787118606.159213:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 20 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.159221:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173440 00000100:00100000:1.0:1787118606.159224:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173440 00010000:00010000:1.0:1787118606.159232:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 21 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.159243:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118606.159249:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3298:x1873929566173056:12345-0@lo:103: 00010000:00010000:1.0:1787118606.159268:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.159273:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 21 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159282:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 21 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159296:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.159326:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3298:x1873929566173056:12345-0@lo:103: Request processed in 77us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.159333:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118606.159346:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118606.159352:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3298:x1873929566173568:12345-0@lo:103: 00010000:00010000:1.0:1787118606.159359:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.159363:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 20 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159371:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 20 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159379:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.159398:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3298:x1873929566173568:12345-0@lo:103: Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.159403:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118606.159413:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118606.159418:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566173184:12345-0@lo:103: 00010000:00010000:1.0:1787118606.159424:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.159427:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 19 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159441:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 19 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159449:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.159469:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566173184:12345-0@lo:103: Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.159481:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118606.159495:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118606.159502:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3300:x1873929566173312:12345-0@lo:103: 00010000:00010000:1.0:1787118606.159510:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.159514:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 18 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159522:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 18 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159532:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118606.159537:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118606.159560:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3300:x1873929566173312:12345-0@lo:103: Request processed in 58us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.159567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118606.159583:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118606.159590:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3300:x1873929566173440:12345-0@lo:103: 00010000:00010000:1.0:1787118606.159597:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.159602:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 17 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159612:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 17 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159631:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159638:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159652:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159659:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159666:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159672:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159677:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118606.159681:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159688:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159696:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.159705:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.159774:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3300:x1873929566173440:12345-0@lo:103: Request processed in 185us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.159790:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118606.159830:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566173440:0@lo:103: 00000100:00100000:1.0:1787118606.159839:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566173312:0@lo:103: 00000100:00100000:1.0:1787118606.159863:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173184:0@lo:103: 00000100:00100000:1.0:1787118606.159870:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173056:0@lo:103: 00000100:00100000:1.0:1787118606.159876:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566173568:0@lo:103: 00010000:00010000:2.0:1787118606.160599:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042200/0xaa534e3c784f8415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f840e expref: 16 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.160621:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172416:0@lo:104: 00010000:00010000:2.0:1787118606.160633:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8d200/0xaa534e3c784f83eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f83e4 expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.160642:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172544:0@lo:104: 00010000:00010000:2.0:1787118606.160651:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031a00/0xaa534e3c784f83cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f83c8 expref: 14 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.160658:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172672:0@lo:104: 00010000:00010000:2.0:1787118606.160666:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613414b0e00/0xaa534e3c784f83a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f839e expref: 13 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.160673:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172800:0@lo:104: 00010000:00010000:2.0:1787118606.160694:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382174800/0xaa534e3c784f837b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8374 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.160702:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1873929566172928:0@lo:104: 00010000:00010000:2.0:1787118606.160757:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.160767:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.160774:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.160780:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382174a00/0xaa534e3c784f842a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787118606.160792:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787118606.218332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:7629:x1873929566172288:12345-0@lo:253: Request processed in 89702us (90002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.218347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787118606.218454:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566172288:0@lo:253: 10000000:01000000:2.0:1787118606.218468:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787118606.218472:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787118606.218474:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118606.218475:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118606.218477:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787118606.218478:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118606.218479:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118606.218481:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118606.218482:0:7629:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787118606.218484:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118606.218485:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787118606.218507:0:7629:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96137a707800 from lustre-OST0001 10000000:01000000:2.0:1787118606.218530:0:7629:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787118606.218532:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787118606.218540:0:7629:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff961346264d40 local copy 10000000:01000000:2.0:1787118606.218555:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787118606.218591:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.218602:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.218673:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.218691:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173696:0@lo:101: 00000100:00100000:2.0:1787118606.218876:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.218953:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166180 going to sleep for 11 seconds 00000100:00100000:0.0:1787118606.218993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173696 00000100:00100000:0.0:1787118606.218999:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173696 00000100:00100000:0.0:1787118606.219076:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787118606.219085:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+11:7629:x1873929566173696:12345-0@lo:101: 00010000:00010000:0.0:1787118606.219096:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118606.219110:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340030a00/0xaa534e3c784f8438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8431 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.219132:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030a00/0xaa534e3c784f8438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8431 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.219140:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340030a00/0xaa534e3c784f8438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8431 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.219160:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030a00, rc 0) 00000100:00100000:0.0:1787118606.219202:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566173696:12345-0@lo:101: Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118606.219207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787118606.219278:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173696:0@lo:101: 00010000:00010000:2.0:1787118606.219290:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.219298:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.219403:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173824:0@lo:501: 00000100:00100000:2.0:1787118606.219429:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.219503:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166180 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.219576:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173824 00000100:00100000:1.0:1787118606.219580:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173824 00000100:00100000:1.0:1787118606.219602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787118606.219620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566173824:12345-0@lo:501: 00000100:00100000:1.0:1787118606.219853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566173824:12345-0@lo:501: Request processed in 244us (422us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118606.219860:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787118606.219996:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173824:0@lo:501: 10000000:01000000:2.0:1787118606.220007:0:7629:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787118606.220033:0:7629:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787118606.220038:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220057:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220064:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220085:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787118606.220104:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96137a707800 10000000:01000000:2.0:1787118606.220108:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787118606.220114:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787118606.220116:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787118606.220120:0:7629:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787118606.220123:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787118606.220137:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220156:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220163:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.220176:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173952:0@lo:101: 00000100:00100000:2.0:1787118606.220205:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.220228:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.220347:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566173952 00000100:00100000:1.0:1787118606.220352:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566173952 00000100:00100000:1.0:1787118606.220373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787118606.220379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566173952:12345-0@lo:101: 00010000:00010000:1.0:1787118606.220387:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118606.220396:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f843f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220422:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f843f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220430:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f843f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220438:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382043200, rc 0) 00000100:00100000:1.0:1787118606.220477:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566173952:12345-0@lo:101: Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.220483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1787118606.220507:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118606.220512:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220518:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174a00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118606.220522:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220528:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118606.220534:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118606.220539:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118606.220557:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220564:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118606.220592:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.220598:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f8431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa534e3c784f8438 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.220695:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566173952:0@lo:101: 00010000:00010000:2.0:1787118606.220718:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.220760:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.220822:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174208:0@lo:501: 00000100:00100000:2.0:1787118606.220851:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.220870:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00010000:00010000:1.0:1787118606.220969:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118606.220972:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118606.220973:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118606.220981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174208 00000100:00100000:1.0:1787118606.220985:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174208 00000100:00100000:1.0:1787118606.221002:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787118606.221008:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174208:12345-0@lo:501: 00000100:00100000:1.0:1787118606.221200:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174208:12345-0@lo:501: Request processed in 190us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.221206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787118606.221233:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566174080:0@lo:103: 00000100:00100000:1.0:1787118606.221258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.221293:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174080 00000100:00100000:1.0:1787118606.221296:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174080 00000100:00100000:1.0:1787118606.221323:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118606.221329:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3299:x1873929566174080:12345-0@lo:103: 00010000:00010000:1.0:1787118606.221337:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.221349:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030a00/0xaa534e3c784f8438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8431 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.221360:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.221387:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3299:x1873929566174080:12345-0@lo:103: Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.221402:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118606.221429:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566174080:0@lo:103: 00000100:00100000:2.0:1787118606.221502:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174208:0@lo:501: 00000100:00100000:2.0:1787118606.221528:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174336:0@lo:503: 00000100:00100000:2.0:1787118606.221568:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.221587:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.221687:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174336 00000100:00100000:1.0:1787118606.221691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174336 00000100:00100000:1.0:1787118606.221893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787118606.221902:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174336:12345-0@lo:503: 00000100:00100000:1.0:1787118606.222056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174336:12345-0@lo:503: Request processed in 155us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.222062:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787118606.222259:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174336:0@lo:503: 00000040:00080000:2.0:1787118606.222507:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118606.222573:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174464:0@lo:502: 00000100:00100000:2.0:1787118606.222675:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.222824:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.222925:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174464 00000100:00100000:1.0:1787118606.222930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174464 00000100:00100000:1.0:1787118606.222990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118606.222996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174464:12345-0@lo:502: 00000100:00100000:1.0:1787118606.223190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174464:12345-0@lo:502: Request processed in 193us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.223197:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787118606.223276:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174464:0@lo:502: 00000040:00080000:2.0:1787118606.223529:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787118606.223579:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787118606.223689:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787118606.223841:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787118606.223881:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787118606.223912:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787118606.223941:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174592:0@lo:502: 00000100:00100000:2.0:1787118606.223982:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.224077:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.224161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174592 00000100:00100000:1.0:1787118606.224167:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174592 00000100:00100000:1.0:1787118606.224193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787118606.224199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174592:12345-0@lo:502: 00000100:00100000:1.0:1787118606.224354:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174592:12345-0@lo:502: Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.224362:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787118606.224482:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174592:0@lo:502: 00000040:00080000:2.0:1787118606.224557:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787118606.224566:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787118606.225301:0:7637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787118606.225310:0:7637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787118606.225317:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118606.225326:0:7637:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787118606.225332:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787118606.225346:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96137abc99c0) 00000020:00000080:1.0:1787118606.225366:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787118606.225372:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787118606.225431:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137a707800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787118606.225437:0:7637:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787118606.225444:0:7637:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa534e3c784f8454 00010000:00010000:1.0:1787118606.229319:0:7637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787118606.229930:0:7637:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787118606.232251:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787118606.232508:0:7637:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787118606.237641:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787118606.240384:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787118606.241599:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787118606.241621:0:7637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118606.241628:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118606.241630:0:7637:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787118606.241634:0:7637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118606.241639:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118606.241640:0:7637:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787118606.241643:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787118606.241645:0:7637:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787118606.241690:0:7637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118606.241694:0:7637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118606.241696:0:7637:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787118606.241700:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787118606.245398:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787118606.245436:0:7629:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787118606.245453:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.245466:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118606.245473:0:7629:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137a707800 from 1 10000000:01000000:2.0:1787118606.245476:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787118606.245511:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.245519:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.245529:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.245553:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174720:0@lo:101: 00000100:00100000:2.0:1787118606.245627:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.245674:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.245842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174720 00000100:00100000:1.0:1787118606.245850:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174720 00000100:00100000:1.0:1787118606.245895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787118606.245903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:7629:x1873929566174720:12345-0@lo:101: 00010000:00010000:1.0:1787118606.245915:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118606.245934:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f845b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.245956:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f845b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.245965:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f845b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.245973:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042600, rc 0) 00000100:00100000:1.0:1787118606.246010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174720:12345-0@lo:101: Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.246016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787118606.246102:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174720:0@lo:101: 00010000:00010000:2.0:1787118606.246116:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.246123:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.246228:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174848:0@lo:501: 00000100:00100000:2.0:1787118606.246258:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.246287:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.246327:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174848 00000100:00100000:1.0:1787118606.246331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174848 00000100:00100000:1.0:1787118606.246361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787118606.246368:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174848:12345-0@lo:501: 00000100:00100000:1.0:1787118606.246584:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174848:12345-0@lo:501: Request processed in 216us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.246591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787118606.246749:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174848:0@lo:501: 00000100:00100000:2.0:1787118606.246774:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174976:0@lo:503: 00000100:00100000:2.0:1787118606.246815:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.246835:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.246949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566174976 00000100:00100000:1.0:1787118606.246953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566174976 00000100:00100000:1.0:1787118606.246985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787118606.246992:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174976:12345-0@lo:503: 00000100:00100000:1.0:1787118606.247296:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566174976:12345-0@lo:503: Request processed in 304us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.247303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787118606.247377:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566174976:0@lo:503: 00000040:00080000:2.0:1787118606.247699:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118606.247989:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175104:0@lo:502: 00000100:00100000:2.0:1787118606.248038:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.248107:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.250419:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175104 00000100:00100000:1.0:1787118606.250432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175104 00000100:00100000:1.0:1787118606.250862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787118606.250872:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566175104:12345-0@lo:502: 00000100:00100000:1.0:1787118606.251157:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566175104:12345-0@lo:502: Request processed in 285us (3117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.251165:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787118606.251275:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175104:0@lo:502: 00000040:00080000:3.0:1787118606.251592:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787118606.251662:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787118606.251699:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175232:0@lo:502: 00000100:00100000:3.0:1787118606.252107:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118606.252140:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118606.252266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175232 00000100:00100000:2.0:1787118606.252273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175232 00000100:00100000:2.0:1787118606.252313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787118606.252321:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566175232:12345-0@lo:502: 00000100:00100000:2.0:1787118606.252471:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566175232:12345-0@lo:502: Request processed in 150us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118606.252478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787118606.252575:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175232:0@lo:502: 00000040:00080000:3.0:1787118606.252668:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787118606.252677:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787118606.253545:0:7641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118606.253556:0:7641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118606.253558:0:7641:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787118606.253565:0:7641:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137a707800 00000020:00000080:2.0:1787118606.253567:0:7641:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787118606.253583:0:7641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118606.253594:0:7641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118606.253596:0:7641:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787118606.253599:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787118606.254034:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787118606.254056:0:7629:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787118606.254106:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.254118:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118606.254165:0:7629:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787118606.254169:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96137a707800 10000000:01000000:3.0:1787118606.254172:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96137a707800 10000000:01000000:3.0:1787118606.254176:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787118606.254188:0:7629:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96137a707800 from 1 10000000:01000000:3.0:1787118606.254191:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787118606.254221:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.254230:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.254239:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118606.254258:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175360:0@lo:101: 00000100:00100000:3.0:1787118606.254311:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118606.254354:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.254406:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175360 00000100:00100000:1.0:1787118606.254411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175360 00000100:00100000:1.0:1787118606.254450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787118606.254458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:7629:x1873929566175360:12345-0@lo:101: 00010000:00010000:1.0:1787118606.254469:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118606.254482:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8469 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.254503:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.254513:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.254521:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042e00, rc 0) 00000100:00100000:1.0:1787118606.254569:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175360:12345-0@lo:101: Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.254575:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787118606.254656:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175360:0@lo:101: 00010000:00010000:0.0:1787118606.254670:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118606.254679:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118606.254854:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175488:0@lo:501: 00000100:00100000:0.0:1787118606.254884:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.254901:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.255040:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175488 00000100:00100000:1.0:1787118606.255044:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175488 00000100:00100000:1.0:1787118606.255076:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787118606.255084:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175488:12345-0@lo:501: 00000100:00100000:1.0:1787118606.255299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175488:12345-0@lo:501: Request processed in 216us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.255312:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787118606.255445:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175488:0@lo:501: 00000100:00100000:0.0:1787118606.255471:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175616:0@lo:503: 00000100:00100000:0.0:1787118606.255508:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.255541:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.255583:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175616 00000100:00100000:1.0:1787118606.255587:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175616 00000100:00100000:1.0:1787118606.255622:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787118606.255628:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175616:12345-0@lo:503: 00000100:00100000:1.0:1787118606.255798:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175616:12345-0@lo:503: Request processed in 170us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.255805:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787118606.255985:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175616:0@lo:503: 00000040:00080000:0.0:1787118606.256275:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787118606.256329:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175744:0@lo:502: 00000100:00100000:0.0:1787118606.256371:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.256405:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118606.256477:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175744 00000100:00100000:3.0:1787118606.256483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175744 00000100:00100000:3.0:1787118606.256518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787118606.256526:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175744:12345-0@lo:502: 00000100:00100000:3.0:1787118606.256702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175744:12345-0@lo:502: Request processed in 177us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118606.256847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787118606.256979:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175744:0@lo:502: 00000040:00080000:0.0:1787118606.257224:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787118606.257273:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787118606.257309:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787118606.257355:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787118606.257394:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787118606.257445:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787118606.257478:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787118606.257518:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787118606.257560:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787118606.257595:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787118606.258083:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787118606.258135:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787118606.258184:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787118606.258216:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787118606.258263:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787118606.258300:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787118606.258338:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787118606.258405:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787118606.258445:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787118606.258481:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787118606.258525:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787118606.258557:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787118606.258590:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787118606.258864:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787118606.258909:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787118606.258942:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787118606.258993:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787118606.259030:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787118606.259063:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787118606.259109:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787118606.259161:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787118606.259198:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787118606.259232:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787118606.259281:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787118606.259320:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787118606.259371:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787118606.259411:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787118606.259456:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175872:0@lo:502: 00000100:00100000:0.0:1787118606.259536:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.259697:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118606.260190:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566175872 00000100:00100000:3.0:1787118606.260199:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566175872 00000100:00100000:3.0:1787118606.260277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787118606.260285:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175872:12345-0@lo:502: 00000100:00100000:3.0:1787118606.260553:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566175872:12345-0@lo:502: Request processed in 268us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118606.260561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787118606.261016:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566175872:0@lo:502: 00000040:00080000:0.0:1787118606.261121:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787118606.261135:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787118606.261663:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787118606.261678:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9613496a3380) 00000020:00000080:0.0:1787118606.261699:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787118606.262087:0:7642:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137a707800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787118606.262092:0:7642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96137a707800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787118606.262095:0:7642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96137a707800 3 00010000:00080000:0.0:1787118606.262123:0:7642:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9613501ce000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.110@tcp at head 00010000:00010000:0.0:1787118606.263696:0:7642:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787118606.263836:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787118606.263872:0:7642:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787118606.263896:0:7642:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa534e3c784f847e 00000100:00080000:0.0:1787118606.263907:0:7642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787118606.263913:0:7642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9613501ce000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118606.263947:0:7642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137abaf100 x1873929566176000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787118606.263990:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566176000:0@lo:38: 00000100:00100000:0.0:1787118606.264058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.264124:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176000 00000100:00100000:0.0:1787118606.264130:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176000 00000100:00100000:0.0:1787118606.264171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118606.264178:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566176000:12345-0@lo:38: 00010000:00080000:0.0:1787118606.264199:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787118606.264224:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa534e3c784f8485 00000004:00100000:0.0:1787118606.264239:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787118606.264273:0:5843:0:(import.c:65:import_set_state_nolock()) ffff96124339c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118606.264319:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873929566176000:12345-0@lo:38: Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118606.264326:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787118606.264361:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abaf100 x1873929566176000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118606.264371:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787118606.264378:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787118606.264384:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787118606.264388:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787118606.264390:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787118606.264395:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566176000:0@lo:38: 00000100:00080000:0.0:1787118606.264414:0:7642:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787118606.264483:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566176128:0@lo:400: 00000100:00100000:0.0:1787118606.264510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.264529:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118606.264534:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566176256:0@lo:400: 00000100:00100000:0.0:1787118606.264555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.264578:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566176384:0@lo:400: 00000100:00100000:0.0:1787118606.264601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.264634:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176128 00000100:00100000:0.0:1787118606.264638:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176128 00000100:00100000:0.0:1787118606.264660:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176256 00000100:00100000:0.0:1787118606.264662:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176256 00000100:00100000:0.0:1787118606.264683:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787118606.264689:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566176128:12345-0@lo:400: 00000100:00100000:0.0:1787118606.264753:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566176128:12345-0@lo:400: Request processed in 63us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118606.264761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787118606.264774:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118606.264780:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566176256:12345-0@lo:400: 00000100:00100000:0.0:1787118606.264807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566176256:12345-0@lo:400: Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118606.264812:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118606.264835:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176384 00000100:00100000:0.0:1787118606.264838:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176384 00000100:00100000:0.0:1787118606.264865:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118606.264871:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566176384:12345-0@lo:400: 00000100:00100000:0.0:1787118606.264903:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566176384:12345-0@lo:400: Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118606.264908:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787118606.264924:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118606.264927:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118606.264945:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abadc00 x1873929566176384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118606.264955:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566176384:0@lo:400: 00010000:00080000:0.0:1787118606.264975:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abace00 x1873929566176256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118606.264983:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566176256:0@lo:400: 00010000:00080000:0.0:1787118606.264992:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137abaf100 x1873929566176128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118606.265012:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566176128:0@lo:400: 00000040:00080000:0.0:1787118606.268989:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787118606.269779:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1873929566176512:0@lo:901: 00000100:00100000:2.0:1787118606.269845:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118606.269889:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176512 00000100:00100000:2.0:1787118606.269894:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176512 00000100:00100000:2.0:1787118606.269937:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118606.269944:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1873929566176512:12345-0@lo:901: 00000100:00100000:2.0:1787118606.270301:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7643:x1873929566176512:12345-0@lo:901: Request processed in 355us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118606.270308:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118606.270336:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166600 going to sleep for 11 seconds 00010000:00080000:2.0:1787118606.270357:0:7643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96136e5b0e00 x1873929566176512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787118622 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118606.270370:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7643:1873929566176512:0@lo:901: 00000100:00080000:0.0:1787118606.271535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1787118606.273285:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787118606.273336:0:7629:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118606.273359:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.273371:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787118606.274248:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787118606.274251:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787118606.274252:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118606.274254:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118606.274255:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118606.274257:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118606.274258:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787118606.274260:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118606.274261:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118606.274263:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118606.274264:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787118606.274267:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787118606.274270:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787118606.274271:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787118606.274273:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118606.274274:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118606.274275:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118606.274276:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118606.274277:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787118606.274278:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118606.274279:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118606.274280:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118606.274281:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787118606.274306:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787118606.274326:0:7629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566176640:0@lo:253: 00000100:00100000:0.0:1787118606.274398:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118606.274446:0:7629:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118606.274500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176640 00000100:00100000:1.0:1787118606.274508:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176640 00000100:00100000:1.0:1787118606.274560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787118606.274568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566176640:12345-0@lo:253: 20000000:01000000:1.0:1787118606.274593:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787118606.274615:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787118606.303526:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787118606.303540:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787118606.303572:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787118606.303576:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787118606.303597:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.303842:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.303851:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.303889:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.303918:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 14 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.303933:0:5857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566176768:0@lo:104: 00000100:00100000:1.0:1787118606.303989:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.304069:0:5857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118606.308182:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176768 00000100:00100000:3.0:1787118606.308196:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176768 00000100:00100000:3.0:1787118606.308261:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787118606.308271:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566176768:12345-0@lo:104: 00010000:00010000:3.0:1787118606.308288:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.308390:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118606.308396:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:5857:x1873929566176768:12345-0@lo:104: Request processed in 128us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118606.308403:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787118606.308411:0:5857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1873929566176768:0@lo:104: 00010000:00010000:0.0:1787118606.308439:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310027:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118606.310038:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310048:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118606.310052:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310060:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118606.310068:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118606.310086:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118606.310126:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310133:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118606.310163:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310169:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8d400/0xaa534e3c784f83d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f83dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118606.310187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118606.310188:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118606.310190:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118606.310204:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566176896:0@lo:103: 00000100:00100000:2.0:1787118606.310261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118606.310497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566176896 00000100:00100000:1.0:1787118606.310504:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566176896 00010000:00010000:1.0:1787118606.310527:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118606.310557:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118606.310566:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350044450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3299:x1873929566176896:12345-0@lo:103: 00010000:00010000:1.0:1787118606.310577:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118606.310583:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310592:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310606:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030c00/0xaa534e3c784f83dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f83d6 expref: 15 pid: 5835 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310624:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310632:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787118606.310657:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007081053s 00010000:00010000:1.0:1787118606.310662:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310667:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310674:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310680:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310685:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118606.310689:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.310696:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118606.311659:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7629:x1873929566176640:12345-0@lo:253: Request processed in 37088us (37256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118606.311669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787118606.311856:0:7629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7629:1873929566176640:0@lo:253: 10000000:01000000:0.0:1787118606.311871:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787118606.311874:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787118606.311876:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787118606.311877:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118606.311878:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118606.311879:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118606.311880:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118606.311881:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787118606.311882:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787118606.311883:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787118606.311885:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118606.311886:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787118606.311899:0:7629:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787118606.316572:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787118606.316999:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787118606.317213:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787118606.317387:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787118606.317845:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787118606.318073:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:3.0:1787118606.318668:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118606.318680:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.318680:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.318691:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042200/0xaa534e3c784f848c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118606.318890:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118606.319012:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350044450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3299:x1873929566176896:12345-0@lo:103: Request processed in 8444us (8747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118606.319023:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00000004:0.0:1787118606.319870:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787118606.320165:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566176896:0@lo:103: 00002000:00080000:3.0:1787118606.553828:0:7629:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787118606.553836:0:7629:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787118606.553864:0:7629:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787118606.553918:0:7629:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787118606.553933:0:7629:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787118606.553960:0:7629:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787118607.115994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118608.144803:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118608.202063:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566177024:0@lo:13: 00000100:00100000:0.0:1787118608.202179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118608.203323:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177024 00000100:00100000:2.0:1787118608.203331:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177024 00000100:00100000:2.0:1787118608.203399:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787118608.203409:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566177024:12345-0@lo:13: 00002000:00000024:2.0:1787118608.203443:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787118608.205216:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118608.214507:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566177024:12345-0@lo:13: Request processed in 11092us (12319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118608.214521:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787118608.220791:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb4a80 x1873929566177024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118608.220818:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566177024:0@lo:13: 00010000:00010000:2.0:1787118609.162202:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118610.187320:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118611.209951:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118611.278978:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566177408:0@lo:400: 00000100:00100000:3.0:1787118611.278987:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566177280:0@lo:400: 00000100:00100000:0.0:1787118611.279043:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566177152:0@lo:400: 00000100:00100000:3.0:1787118611.281843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118611.281934:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177280 00000100:00100000:3.0:1787118611.281941:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177280 00000100:00100000:3.0:1787118611.281985:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787118611.281995:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566177280:12345-0@lo:400: 00000100:00100000:3.0:1787118611.282047:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566177280:12345-0@lo:400: Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118611.282054:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787118611.282093:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb5f80 x1873929566177280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118611.282107:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566177280:0@lo:400: 00000100:00100000:1.0:1787118611.285871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118611.286848:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566177536:0@lo:400: 00000100:00100000:1.0:1787118611.286970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118611.287027:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177536 00000100:00100000:1.0:1787118611.287034:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177536 00000100:00100000:1.0:1787118611.287084:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787118611.287098:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566177536:12345-0@lo:400: 00000100:00100000:1.0:1787118611.287169:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566177536:12345-0@lo:400: Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118611.287176:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787118611.287197:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787118611.287224:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb4e00 x1873929566177536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118611.287237:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566177536:0@lo:400: 00000100:00100000:0.0:1787118611.287291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118611.287380:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566177664:0@lo:400: 00000100:00100000:0.0:1787118611.287407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118611.287439:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177408 00000100:00100000:0.0:1787118611.287443:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177408 00000100:00100000:0.0:1787118611.287475:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177664 00000100:00100000:0.0:1787118611.287478:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177664 00000100:00100000:0.0:1787118611.287493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118611.287501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566177408:12345-0@lo:400: 00000100:00100000:1.0:1787118611.287530:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787118611.287539:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787118611.287544:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566177408:12345-0@lo:400: Request processed in 43us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118611.287552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118611.287567:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787118611.287574:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566177664:12345-0@lo:400: 00000100:00100000:0.0:1787118611.287610:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566177664:12345-0@lo:400: Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118611.287617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787118611.287645:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118611.287670:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb4000 x1873929566177408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118611.287695:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566177408:0@lo:400: 00010000:00080000:0.0:1787118611.287744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb5c00 x1873929566177664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118611.287754:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566177664:0@lo:400: 00000100:00100000:3.0:1787118611.293463:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177152 00000100:00100000:3.0:1787118611.293478:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177152 00000100:00100000:3.0:1787118611.293535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787118611.293544:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3301:x1873929566177152:12345-0@lo:400: 00000100:00100000:3.0:1787118611.293632:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3301:x1873929566177152:12345-0@lo:400: Request processed in 89us (6342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118611.293638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787118611.293877:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566177152:0@lo:400: 00010000:00010000:3.0:1787118612.234819:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787118612.298523:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787118612.298531:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961375697800 from 30 10000000:01000000:2.0:1787118612.298537:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787118612.298581:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.298593:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.298605:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118612.298631:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566177792:0@lo:101: 00000100:00100000:2.0:1787118612.298844:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.298945:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.305745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177792 00000100:00100000:1.0:1787118612.305759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177792 00000100:00100000:1.0:1787118612.306586:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787118612.306599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566177792:12345-0@lo:101: 00010000:00010000:1.0:1787118612.306616:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118612.306636:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8493 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.306661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.306881:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.306890:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042c00, rc 0) 00000100:00100000:1.0:1787118612.306964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566177792:12345-0@lo:101: Request processed in 368us (8119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.306971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787118612.307070:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566177792:0@lo:101: 00010000:00010000:2.0:1787118612.307088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.307097:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118612.307174:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566177920:0@lo:501: 00000100:00100000:2.0:1787118612.307219:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.307261:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.311502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566177920 00000100:00100000:1.0:1787118612.311516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566177920 00000100:00100000:1.0:1787118612.311579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787118612.311589:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566177920:12345-0@lo:501: 00000100:00100000:1.0:1787118612.312259:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566177920:12345-0@lo:501: Request processed in 670us (5037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.312267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787118612.313040:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566177920:0@lo:501: 00000100:00100000:1.0:1787118612.313094:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178048:0@lo:503: 00000100:00100000:1.0:1787118612.313155:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.313246:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118612.321718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178048 00000100:00100000:2.0:1787118612.321744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178048 00000100:00100000:2.0:1787118612.321814:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787118612.321825:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566178048:12345-0@lo:503: 00000100:00100000:2.0:1787118612.322230:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566178048:12345-0@lo:503: Request processed in 406us (9073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118612.322237:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787118612.322786:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178048:0@lo:503: 00000100:00100000:0.0:1787118612.324184:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7931:1873929566178176:0@lo:502: 00000100:00100000:0.0:1787118612.324260:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118612.324304:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.324424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178176 00000100:00100000:1.0:1787118612.324430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178176 00000100:00100000:1.0:1787118612.324478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787118612.324488:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7931:x1873929566178176:12345-0@lo:502: 00000100:00100000:1.0:1787118612.326362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7931:x1873929566178176:12345-0@lo:502: Request processed in 1869us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.326374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787118612.333857:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7931:1873929566178176:0@lo:502: 00000100:00100000:0.0:1787118612.334030:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7931:1873929566178304:0@lo:502: 00000100:00100000:0.0:1787118612.334100:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118612.334217:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.335215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178304 00000100:00100000:3.0:1787118612.335224:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178304 00000100:00100000:2.0:1787118612.339494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787118612.339512:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7931:x1873929566178304:12345-0@lo:502: 00000100:00100000:2.0:1787118612.339805:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:7931:x1873929566178304:12345-0@lo:502: Request processed in 299us (5705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118612.339813:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787118612.344599:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7931:1873929566178304:0@lo:502: 00000040:00080000:1.0:1787118612.344656:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787118612.344762:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787118612.344783:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787118612.344794:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.344806:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118612.344816:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787118612.344819:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787118612.344822:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787118612.344856:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.344863:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.344870:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118612.344889:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178432:0@lo:101: 00000100:00100000:1.0:1787118612.344947:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.344985:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.345001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178432 00000100:00100000:1.0:1787118612.345006:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178432 00000100:00100000:1.0:1787118612.345045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787118612.345055:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566178432:12345-0@lo:101: 00010000:00010000:1.0:1787118612.345068:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118612.345087:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f84a1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.345123:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.345133:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.345141:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042800, rc 0) 00000100:00100000:1.0:1787118612.345176:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566178432:12345-0@lo:101: Request processed in 123us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.345183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787118612.345222:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178432:0@lo:101: 00010000:00010000:1.0:1787118612.345233:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.345241:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118612.345286:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178560:0@lo:501: 00000100:00100000:1.0:1787118612.345309:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.345324:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.345335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178560 00000100:00100000:1.0:1787118612.345338:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178560 00000100:00100000:1.0:1787118612.345360:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787118612.345366:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566178560:12345-0@lo:501: 00000100:00100000:1.0:1787118612.346381:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566178560:12345-0@lo:501: Request processed in 1013us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.346466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787118612.346518:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178560:0@lo:501: 00000100:00100000:1.0:1787118612.346556:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178688:0@lo:503: 00000100:00100000:1.0:1787118612.346665:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.346683:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.346698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178688 00000100:00100000:1.0:1787118612.346702:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178688 00000100:00100000:1.0:1787118612.346745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787118612.346752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566178688:12345-0@lo:503: 00000100:00100000:1.0:1787118612.347021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566178688:12345-0@lo:503: Request processed in 269us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.347027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787118612.347066:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566178688:0@lo:503: 00000100:00100000:3.0:1787118612.362261:0:7934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7934:1873929566178816:0@lo:502: 00000100:00100000:3.0:1787118612.362342:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.362388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178816 00000100:00100000:3.0:1787118612.362394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178816 00000100:00100000:3.0:1787118612.362433:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787118612.362448:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7934:x1873929566178816:12345-0@lo:502: 00000100:00100000:3.0:1787118612.362696:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7934:x1873929566178816:12345-0@lo:502: Request processed in 248us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.362705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787118612.362774:0:7934:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.362795:0:7934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7934:1873929566178816:0@lo:502: 00000020:01000000:3.0:1787118612.362828:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118612.362837:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.362840:0:7934:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787118612.362845:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787118612.362847:0:7934:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787118612.362862:0:7934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7934:1873929566178944:0@lo:502: 00000100:00100000:3.0:1787118612.362895:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.362919:0:7934:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.362947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566178944 00000100:00100000:3.0:1787118612.362951:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566178944 00000100:00100000:3.0:1787118612.362975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787118612.362981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7934:x1873929566178944:12345-0@lo:502: 00000100:00100000:3.0:1787118612.363093:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:7934:x1873929566178944:12345-0@lo:502: Request processed in 112us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.363100:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787118612.363152:0:7934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7934:1873929566178944:0@lo:502: 00000020:01000000:3.0:1787118612.363172:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118612.363176:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.363177:0:7934:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787118612.363181:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787118612.363287:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787118612.363309:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787118612.363323:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363334:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118612.363344:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787118612.363347:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961347c3c800 from 30 10000000:01000000:3.0:1787118612.363349:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787118612.363371:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363379:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363388:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118612.363400:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179072:0@lo:101: 00000100:00100000:3.0:1787118612.363426:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.363440:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.363453:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179072 00000100:00100000:3.0:1787118612.363457:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179072 00000100:00100000:3.0:1787118612.363477:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118612.363483:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566179072:12345-0@lo:101: 00010000:00010000:3.0:1787118612.363491:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118612.363502:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f84af expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363522:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f84af expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363538:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84af expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363546:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118612.363574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179072:12345-0@lo:101: Request processed in 90us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.363580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118612.363607:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179072:0@lo:101: 00010000:00010000:3.0:1787118612.363619:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.363627:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118612.363661:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179200:0@lo:501: 00000100:00100000:3.0:1787118612.363683:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.363695:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.363705:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179200 00000100:00100000:3.0:1787118612.363708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179200 00000100:00100000:3.0:1787118612.363749:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787118612.363756:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179200:12345-0@lo:501: 00000100:00100000:3.0:1787118612.363943:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179200:12345-0@lo:501: Request processed in 187us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.363950:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787118612.363978:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179200:0@lo:501: 00000100:00100000:3.0:1787118612.364002:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179328:0@lo:503: 00000100:00100000:3.0:1787118612.364038:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.364059:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.364070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179328 00000100:00100000:3.0:1787118612.364073:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179328 00000100:00100000:3.0:1787118612.364093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787118612.364099:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179328:12345-0@lo:503: 00000100:00100000:3.0:1787118612.364238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179328:12345-0@lo:503: Request processed in 138us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.364245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787118612.364280:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179328:0@lo:503: 00000100:00100000:2.0:1787118612.364960:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7935:1873929566179456:0@lo:502: 00000100:00100000:2.0:1787118612.365000:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.365032:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343166b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.365071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179456 00000100:00100000:3.0:1787118612.365076:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179456 00000100:00100000:3.0:1787118612.365117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787118612.365125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:7935:x1873929566179456:12345-0@lo:502: 00000100:00100000:3.0:1787118612.365355:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:7935:x1873929566179456:12345-0@lo:502: Request processed in 230us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.365363:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787118612.366805:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7935:1873929566179456:0@lo:502: 00000100:00100000:1.0:1787118612.366889:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7935:1873929566179584:0@lo:502: 00000100:00100000:1.0:1787118612.366947:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.367030:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.369031:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179584 00000100:00100000:3.0:1787118612.369043:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179584 00000100:00100000:3.0:1787118612.369094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787118612.369113:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:7935:x1873929566179584:12345-0@lo:502: 00000100:00100000:3.0:1787118612.369380:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:7935:x1873929566179584:12345-0@lo:502: Request processed in 278us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.369388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787118612.371686:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7935:1873929566179584:0@lo:502: 00000040:00080000:2.0:1787118612.371756:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787118612.373338:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787118612.373375:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118612.373386:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.373418:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118612.373428:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787118612.373431:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff961347c3c800 from 5 10000000:01000000:3.0:1787118612.373434:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787118612.373469:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.373477:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.373487:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118612.373507:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179712:0@lo:101: 00000100:00100000:3.0:1787118612.373569:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.373614:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961345553300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.373638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179712 00000100:00100000:3.0:1787118612.373643:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179712 00000100:00100000:3.0:1787118612.373683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787118612.373690:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566179712:12345-0@lo:101: 00010000:00010000:3.0:1787118612.373702:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118612.373714:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8c200/0xaa534e3c784f84c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f84bd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.374996:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8c200/0xaa534e3c784f84c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f84bd expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.375031:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8c200/0xaa534e3c784f84c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84bd expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.375039:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c200, rc 0) 00000100:00100000:3.0:1787118612.375117:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566179712:12345-0@lo:101: Request processed in 1425us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.375124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787118612.375157:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179712:0@lo:101: 00010000:00010000:2.0:1787118612.375176:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.375186:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118612.375250:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179840:0@lo:256: 00000100:00100000:2.0:1787118612.375287:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.375324:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.375427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179840 00000100:00100000:3.0:1787118612.375433:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179840 00000100:00100000:3.0:1787118612.375467:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787118612.375474:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566179840:12345-0@lo:256: 20000000:01000000:3.0:1787118612.375489:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787118612.375506:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787118612.375509:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787118612.375599:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566179840:12345-0@lo:256: Request processed in 124us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.375606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787118612.375639:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179840:0@lo:256: 10000000:01000000:2.0:1787118612.375685:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787118612.375691:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.375701:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118612.375710:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787118612.375712:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787118612.375715:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787118612.375754:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.375761:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118612.375769:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118612.375781:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179968:0@lo:101: 00000100:00100000:2.0:1787118612.375807:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.375827:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.375846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566179968 00000100:00100000:3.0:1787118612.375851:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566179968 00000100:00100000:3.0:1787118612.375880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787118612.376266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566179968:12345-0@lo:101: 00010000:00010000:3.0:1787118612.376277:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118612.376290:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f84cb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.376308:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.376468:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.376477:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d800, rc 0) 00000100:00100000:3.0:1787118612.376511:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566179968:12345-0@lo:101: Request processed in 626us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.376518:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787118612.376555:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566179968:0@lo:101: 00010000:00010000:3.0:1787118612.376567:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.376575:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118612.376622:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180096:0@lo:501: 00000100:00100000:3.0:1787118612.376643:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.376987:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378533780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118612.379158:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180096 00000100:00100000:2.0:1787118612.379179:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180096 00000100:00100000:3.0:1787118612.380450:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787118612.380462:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566180096:12345-0@lo:501: 00000100:00100000:3.0:1787118612.380771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566180096:12345-0@lo:501: Request processed in 311us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.380780:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787118612.380822:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180096:0@lo:501: 00000100:00100000:3.0:1787118612.380867:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180224:0@lo:503: 00000100:00100000:3.0:1787118612.380912:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.380963:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378533780 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.380979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180224 00000100:00100000:3.0:1787118612.380983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180224 00000100:00100000:3.0:1787118612.381003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787118612.381009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566180224:12345-0@lo:503: 00000100:00100000:3.0:1787118612.381298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566180224:12345-0@lo:503: Request processed in 288us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.381305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787118612.381343:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180224:0@lo:503: 00000100:00100000:3.0:1787118612.381568:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7936:1873929566180352:0@lo:502: 00000100:00100000:3.0:1787118612.381602:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.381621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180352 00000100:00100000:3.0:1787118612.381625:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180352 00000100:00100000:3.0:1787118612.381647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787118612.381653:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:7936:x1873929566180352:12345-0@lo:502: 00000100:00100000:3.0:1787118612.381876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:7936:x1873929566180352:12345-0@lo:502: Request processed in 222us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.381883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787118612.381919:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378533780 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.381932:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7936:1873929566180352:0@lo:502: 00000020:01000000:3.0:1787118612.381954:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787118612.381962:0:7936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787118612.381968:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.381971:0:7936:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787118612.381975:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787118612.381979:0:7936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.110@tcp to nid 0x20000c0a8cb6e (192.168.203.110@tcp) 00000020:01000000:3.0:1787118612.382000:0:7936:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787118612.382008:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787118612.382022:0:7936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96137a6b3380) 00000020:00000080:3.0:1787118612.382043:0:7936:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787118612.382049:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787118612.382141:0:7936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787118612.382146:0:7936:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787118612.382153:0:7936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f84e0 00010000:00080000:3.0:1787118612.382182:0:7936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9612423d4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:3.0:1787118612.382405:0:7936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787118612.382681:0:7936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787118612.382691:0:7936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787118612.383205:0:7936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787118612.383428:0:7936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787118612.383480:0:7936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787118612.383539:0:7936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787118612.388471:0:7937:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118612.388479:0:7937:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787118612.389366:0:7936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787118612.389378:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787118612.389420:0:7936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787118612.389441:0:7936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f84e7 00000100:00080000:3.0:1787118612.389452:0:7936:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787118612.389458:0:7936:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9612423d4800 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118612.389492:0:7936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137abb7100 x1873929566180480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787118612.389520:0:7936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787118612.389598:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566180480:0@lo:8: 00000100:00100000:1.0:1787118612.389664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787118612.389852:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118612.389856:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.389859:0:7936:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787118612.389862:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118612.389865:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.389866:0:7936:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787118612.389869:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787118612.389876:0:7936:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787118612.389901:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7936:1873929566180608:0@lo:502: 00000100:00100000:3.0:1787118612.389957:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.389985:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180608 00000100:00100000:3.0:1787118612.389990:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180608 00000100:00100000:3.0:1787118612.390026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787118612.390034:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:7936:x1873929566180608:12345-0@lo:502: 00000100:00100000:3.0:1787118612.390254:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:7936:x1873929566180608:12345-0@lo:502: Request processed in 220us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.390261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787118612.390303:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136004ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.390321:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:7936:1873929566180608:0@lo:502: 00000020:01000000:3.0:1787118612.390350:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118612.390354:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118612.390356:0:7936:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787118612.390359:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787118612.390621:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787118612.390639:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787118612.390649:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.390659:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118612.390669:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787118612.390671:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff961346264d40 from 1 10000000:01000000:3.0:1787118612.390674:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787118612.390698:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.390718:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118612.390751:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118612.390764:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180736:0@lo:101: 00000100:00100000:3.0:1787118612.390792:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.390811:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e92df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.390920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180736 00000100:00100000:1.0:1787118612.390925:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180736 00000100:00100000:1.0:1787118612.390972:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787118612.390980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566180736:12345-0@lo:101: 00010000:00010000:1.0:1787118612.390988:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118612.391006:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f84ee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.391026:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.391035:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.391044:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042000, rc 0) 00000100:00100000:1.0:1787118612.391079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566180736:12345-0@lo:101: Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.391084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787118612.391129:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180736:0@lo:101: 00010000:00010000:1.0:1787118612.391142:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.391149:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118612.391191:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180864:0@lo:501: 00000100:00100000:1.0:1787118612.391216:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.391231:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613785b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.391243:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180864 00000100:00100000:1.0:1787118612.391246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180864 00000100:00100000:1.0:1787118612.391268:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787118612.391274:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566180864:12345-0@lo:501: 00000100:00100000:1.0:1787118612.391597:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566180864:12345-0@lo:501: Request processed in 322us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118612.391613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787118612.391647:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566180864:0@lo:501: 10000000:01000000:1.0:1787118612.391669:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787118612.391675:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118612.391683:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118612.391821:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180480 00000100:00100000:1.0:1787118612.391826:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180480 00000100:00100000:1.0:1787118612.391856:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787118612.391861:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1873929566180480:12345-0@lo:8: 00010000:00080000:1.0:1787118612.391882:0:6705:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1787118612.391914:0:6705:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f84fc 00002000:00100000:1.0:1787118612.391928:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96137a3d3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113903 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787118612.392023:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787118612.392026:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787118612.392131:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787118612.392270:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787118612.392291:0:6705:0:(import.c:65:import_set_state_nolock()) ffff96137a3d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118612.392347:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1873929566180480:12345-0@lo:8: Request processed in 485us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.392354:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787118612.392509:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb7100 x1873929566180480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787118622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.392518:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787118612.392525:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787118612.392532:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787118612.392537:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787118612.392539:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9612423d4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787118612.392564:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787118612.392569:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566180480:0@lo:8: 00000100:00100000:2.0:1787118612.392752:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566181248:0@lo:400: 00000100:00100000:2.0:1787118612.392787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.392811:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118612.392817:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566181376:0@lo:400: 00000100:00100000:2.0:1787118612.392842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787118612.392866:0:7937:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787118612.393228:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566180992:0@lo:400: 00000100:00100000:3.0:1787118612.393258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.393278:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118612.393284:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566181120:0@lo:400: 00000100:00100000:3.0:1787118612.393306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.393332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181376 00000100:00100000:3.0:1787118612.393337:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181376 00000100:00100000:3.0:1787118612.393367:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566180992 00000100:00100000:3.0:1787118612.393381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566180992 00000100:00100000:3.0:1787118612.393562:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181120 00000100:00100000:3.0:1787118612.393565:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181120 00000100:00100000:3.0:1787118612.393579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787118612.393586:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566181376:12345-0@lo:400: 00000100:00100000:3.0:1787118612.393629:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566181376:12345-0@lo:400: Request processed in 43us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.393636:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787118612.393650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787118612.393656:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566180992:12345-0@lo:400: 00000100:00100000:3.0:1787118612.393686:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566180992:12345-0@lo:400: Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.393692:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787118612.393703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787118612.393709:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566181120:12345-0@lo:400: 00000100:00100000:3.0:1787118612.393754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566181120:12345-0@lo:400: Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118612.393759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787118612.393795:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b3b80 x1873929566181376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.393806:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566181376:0@lo:400: 00010000:00080000:3.0:1787118612.393832:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b3100 x1873929566181120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.393840:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566181120:0@lo:400: 00010000:00080000:3.0:1787118612.393847:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1f80 x1873929566180992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.393866:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566180992:0@lo:400: 00000004:00080000:2.0:1787118612.394047:0:7937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 191551323798ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787118612.394776:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181248 00000100:00100000:0.0:1787118612.394784:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181248 00000100:00100000:0.0:1787118612.394821:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787118612.394829:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566181248:12345-0@lo:400: 00000100:00100000:0.0:1787118612.394884:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566181248:12345-0@lo:400: Request processed in 56us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118612.394890:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787118612.398191:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1180 x1873929566181248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.398207:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566181248:0@lo:400: 00000004:00080000:1.0:1787118612.491509:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787118612.585940:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566181504:0@lo:13: 00000100:00100000:3.0:1787118612.586005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787118612.586253:0:7938:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787118612.586287:0:7938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181632:0@lo:7: 00000100:00100000:1.0:1787118612.586317:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.586339:0:7938:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d26e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.586367:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181632 00000100:00100000:1.0:1787118612.586374:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181632 00000100:00100000:1.0:1787118612.586429:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787118612.586439:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7938:x1873929566181632:12345-0@lo:7: 00000100:00080000:0.0:1787118612.588779:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118612.591226:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181504 00000100:00100000:2.0:1787118612.591238:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181504 00000100:00100000:2.0:1787118612.591292:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118612.591304:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566181504:12345-0@lo:13: 00002000:00000024:2.0:1787118612.591333:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00002000:00080000:1.0:1787118612.595525:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787118612.595533:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787118612.597256:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7938:x1873929566181632:12345-0@lo:7: Request processed in 10811us (10929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118612.597270:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787118612.597351:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566181632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787118628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118612.597366:0:7938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181632:0@lo:7: 00000004:00080000:1.0:1787118612.597378:0:7938:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787118612.597419:0:7938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181760:0@lo:5: 00000100:00100000:1.0:1787118612.597454:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.597492:0:7938:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d26e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787118612.597667:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566181504:12345-0@lo:13: Request processed in 6364us (11659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118612.597677:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787118612.598835:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c9c00 x1873929566181504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.598857:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566181504:0@lo:13: 00000100:00100000:2.0:1787118612.598937:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181760 00000100:00100000:2.0:1787118612.598945:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181760 00000100:00100000:2.0:1787118612.599000:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118612.599008:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1873929566181760:12345-0@lo:5: 00002000:00080000:2.0:1787118612.599036:0:6703:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787118612.599040:0:6703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787118612.600019:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7938:x1873929566181760:12345-0@lo:5: Request processed in 1009us (2561us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787118612.600029:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787118612.600262:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566181760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118612.600274:0:7938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181760:0@lo:5: 00000004:00080000:1.0:1787118612.600286:0:7938:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787118612.600321:0:7938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181888:0@lo:700: 00000100:00100000:1.0:1787118612.600357:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118612.600408:0:7938:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d26e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118612.600653:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566181888 00000100:00100000:3.0:1787118612.600659:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566181888 00000100:00100000:3.0:1787118612.600691:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787118612.600698:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7938:x1873929566181888:12345-0@lo:700: 00000100:00100000:3.0:1787118612.600758:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1873929566182016:0@lo:700: 00000100:00100000:3.0:1787118612.600790:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118612.600806:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e92d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118612.601241:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182016 00000100:00100000:2.0:1787118612.601254:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182016 00000100:00100000:2.0:1787118612.601291:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118612.601299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1873929566182016:12345-0@lo:700: 40000000:02000000:2.0:1787118612.686545:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787118612.691033:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1873929566182016:12345-0@lo:700: Request processed in 89728us (90234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118612.691047:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787118612.691136:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb4a80 x1873929566182016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787118628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.691151:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1873929566182016:0@lo:700: 40000000:02000000:3.0:1787118612.691164:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787118612.806369:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7938:x1873929566181888:12345-0@lo:700: Request processed in 205662us (206002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118612.806388:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1787118612.806465:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787118612.806481:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:1.0:1787118612.806555:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c9c00 x1873929566181888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787118628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118612.806580:0:7938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566181888:0@lo:700: 00000004:02000040:0.0:1787118612.861288:0:7938:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787118612.867023:0:7938:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566182144:0@lo:5: 00000100:00100000:2.0:1787118612.867091:0:7938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118612.867215:0:7938:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613517e3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118612.867676:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182144 00000100:00100000:1.0:1787118612.867684:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182144 00000100:00100000:2.0:1787118612.868212:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787118612.868224:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7938:x1873929566182144:12345-0@lo:5: 00002000:00080000:2.0:1787118612.873901:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787118612.873922:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787118612.880108:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7938:x1873929566182144:12345-0@lo:5: Request processed in 11870us (13000us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787118612.880122:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787118612.880196:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b2a00 x1873929566182144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.880209:0:7938:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787118612.880234:0:7938:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96136e5b2a00 x1873929566182144/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787118628 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118612.880246:0:7938:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1873929566182144:0@lo:5: 00000004:00080000:3.0:1787118612.880259:0:7938:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1787118612.949385:0:7995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787118613.259088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118613.326550:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118613.326576:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566182272:0@lo:13: 00000100:00100000:2.0:1787118613.326643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118613.326713:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182272 00000100:00100000:2.0:1787118613.326745:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182272 00000100:00100000:2.0:1787118613.326813:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118613.326825:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566182272:12345-0@lo:13: 00002000:00000024:2.0:1787118613.326875:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787118613.327475:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118613.327541:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1880 x1873929566182272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118613.327560:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566182272:0@lo:13: 00000100:00100000:2.0:1787118613.328053:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566182272:12345-0@lo:13: Request processed in 1231us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118613.328061:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787118614.281947:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118615.306045:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118616.329977:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118617.357247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118617.427484:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566182656:0@lo:400: 00000100:00100000:0.0:1787118617.427638:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566182400:0@lo:400: 00000100:00100000:0.0:1787118617.427753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118617.427825:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566182528:0@lo:400: 00000100:00100000:2.0:1787118617.427863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118617.427938:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566183040:0@lo:400: 00000100:00100000:2.0:1787118617.427966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118617.428024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182528 00000100:00100000:2.0:1787118617.428033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182528 00000100:00100000:2.0:1787118617.428104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118617.428115:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566182528:12345-0@lo:400: 00000100:00100000:2.0:1787118617.428194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566182528:12345-0@lo:400: Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118617.428205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118617.428235:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183040 00000100:00100000:2.0:1787118617.428238:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183040 00000100:00100000:2.0:1787118617.428288:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118617.428295:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566183040:12345-0@lo:400: 00000100:00100000:2.0:1787118617.428327:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566183040:12345-0@lo:400: Request processed in 33us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118617.428333:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787118617.428377:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb6300 x1873929566182528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118617.428394:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566182528:0@lo:400: 00010000:00080000:2.0:1787118617.428406:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375beb800 x1873929566183040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118617.428430:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566183040:0@lo:400: 00000100:00080000:2.0:1787118617.428469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118617.429409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118617.429467:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118617.429481:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566182784:0@lo:400: 00000100:00100000:3.0:1787118617.429519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118617.429704:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182656 00000100:00100000:2.0:1787118617.429711:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182656 00000100:00100000:2.0:1787118617.429794:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787118617.429805:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566182656:12345-0@lo:400: 00000100:00100000:2.0:1787118617.429866:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566182656:12345-0@lo:400: Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118617.429873:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787118617.429901:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182784 00000100:00100000:2.0:1787118617.429905:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182784 00000100:00100000:2.0:1787118617.429931:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118617.429938:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566182784:12345-0@lo:400: 00000100:00100000:2.0:1787118617.429975:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566182784:12345-0@lo:400: Request processed in 37us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118617.429981:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787118617.430042:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb5f80 x1873929566182784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118617.430054:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566182784:0@lo:400: 00010000:00080000:2.0:1787118617.430075:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb5c00 x1873929566182656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118617.430084:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566182656:0@lo:400: 00000100:00080000:3.0:1787118617.430494:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118617.430501:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118617.448475:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566182912:0@lo:400: 00000100:00100000:0.0:1787118617.448584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118617.449764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182400 00000100:00100000:1.0:1787118617.449780:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182400 00000100:00100000:1.0:1787118617.449859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787118617.449870:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566182400:12345-0@lo:400: 00000100:00100000:1.0:1787118617.449974:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566182400:12345-0@lo:400: Request processed in 105us (22220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118617.449983:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787118617.453879:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566182400:0@lo:400: 00000100:00100000:2.0:1787118617.455883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566182912 00000100:00100000:2.0:1787118617.455899:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566182912 00000100:00100000:3.0:1787118617.465926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787118617.465947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566182912:12345-0@lo:400: 00000100:00100000:3.0:1787118617.466112:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566182912:12345-0@lo:400: Request processed in 161us (17517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118617.466120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787118617.468024:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375be9880 x1873929566182912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118617.468321:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566182912:0@lo:400: 00000100:00080000:0.0:1787118617.475535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118617.935905:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787118617.935934:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566183168:0@lo:13: 00000100:00100000:3.0:1787118617.936032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118617.944918:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183168 00000100:00100000:0.0:1787118617.944937:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183168 00000100:00100000:0.0:1787118617.945030:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787118617.945044:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566183168:12345-0@lo:13: 00002000:00000024:0.0:1787118617.950486:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118617.950645:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566183168:12345-0@lo:13: Request processed in 5597us (14616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118617.950658:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787118617.952284:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375bebb80 x1873929566183168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118617.952319:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566183168:0@lo:13: 00000001:00080000:1.0:1787118618.096622:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787118618.377850:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118618.443864:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118618.443891:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566183296:0@lo:13: 00000100:00100000:0.0:1787118618.443957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118618.444058:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183296 00000100:00100000:2.0:1787118618.444085:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183296 00000100:00100000:2.0:1787118618.444153:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787118618.444163:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566183296:12345-0@lo:13: 00002000:00000024:2.0:1787118618.444198:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118618.444243:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566183296:12345-0@lo:13: Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118618.444250:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787118618.444453:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1880 x1873929566183296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118618.444471:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566183296:0@lo:13: 00010000:00010000:3.0:1787118619.405935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118619.611487:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.611717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544138880 00000100:00100000:1.0:1787118619.611744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544138880 00000100:00100000:1.0:1787118619.611788:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 113 00000100:00100000:1.0:1787118619.611796:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2367:x1873929544138880:12345-192.168.203.10@tcp:250: 00010000:00080000:1.0:1787118619.611824:0:5835:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 192bbd4a-7266-4705-8616-813bbeea405e@192.168.203.10@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1787118619.611851:0:5835:0:(genops.c:1406:class_connect()) connect: client 192bbd4a-7266-4705-8616-813bbeea405e, cookie 0xaa534e3c784f8503 00000100:00080000:1.0:1787118619.611989:0:5835:0:(import.c:65:import_set_state_nolock()) ffff96137f888000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118619.612070:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+5:2367:x1873929544138880:12345-192.168.203.10@tcp:250: Request processed in 272us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.612078:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 113 00000100:00100000:2.0:1787118619.628302:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.628550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139008 00000100:00100000:3.0:1787118619.628568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139008 00000100:00100000:3.0:1787118619.628620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 114 00000100:00100000:3.0:1787118619.628629:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+5:5597:x1873929544139008:12345-192.168.203.10@tcp:101: 00010000:00010000:3.0:1787118619.628644:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118619.628659:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b7f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.628685:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.628696:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.628705:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8da00, rc 0) 00000100:00100000:3.0:1787118619.628776:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+6:5597:x1873929544139008:12345-192.168.203.10@tcp:101: Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118619.628783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 114 00000100:00100000:0.0:1787118619.631796:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118619.631827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139136 00000100:00100000:0.0:1787118619.631834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139136 00000100:00100000:0.0:1787118619.631873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 115 00000100:00100000:0.0:1787118619.631881:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+6:5597:x1873929544139136:12345-192.168.203.10@tcp:501: 00000100:00100000:0.0:1787118619.632180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+6:5597:x1873929544139136:12345-192.168.203.10@tcp:501: Request processed in 298us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787118619.632189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 115 00000100:00100000:0.0:1787118619.654031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.654131:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139264 00000100:00100000:3.0:1787118619.654141:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139264 00000100:00100000:3.0:1787118619.654201:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00100000:3.0:1787118619.654211:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+6:5597:x1873929544139264:12345-192.168.203.10@tcp:101: 00010000:00010000:3.0:1787118619.654225:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118619.654242:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b7f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.654278:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.654296:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.654305:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118619.654367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+7:5597:x1873929544139264:12345-192.168.203.10@tcp:101: Request processed in 157us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118619.654373:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00100000:3.0:1787118619.657891:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.658353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139392 00000100:00100000:1.0:1787118619.658361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139392 00000100:00100000:1.0:1787118619.658411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:1.0:1787118619.658421:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+7:5597:x1873929544139392:12345-192.168.203.10@tcp:501: 00000100:00100000:1.0:1787118619.658701:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+8:5597:x1873929544139392:12345-192.168.203.10@tcp:501: Request processed in 280us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.658708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:0.0:1787118619.661995:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118619.662980:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139520 00000100:00100000:2.0:1787118619.662991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139520 00000100:00100000:2.0:1787118619.663048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 118 00000100:00100000:2.0:1787118619.663067:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+8:5597:x1873929544139520:12345-192.168.203.10@tcp:503: 00000100:00100000:2.0:1787118619.664203:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+8:5597:x1873929544139520:12345-192.168.203.10@tcp:503: Request processed in 1134us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118619.664212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 118 00000100:00100000:1.0:1787118619.675766:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118619.675867:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139648 00000100:00100000:2.0:1787118619.675877:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139648 00000100:00100000:2.0:1787118619.675935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 119 00000100:00100000:2.0:1787118619.675946:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+8:5615:x1873929544139648:12345-192.168.203.10@tcp:502: 00000100:00100000:2.0:1787118619.676422:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+8:5615:x1873929544139648:12345-192.168.203.10@tcp:502: Request processed in 478us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118619.676431:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 119 00000100:00100000:3.0:1787118619.731441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.731586:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139776 00000100:00100000:1.0:1787118619.731596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139776 00000100:00100000:1.0:1787118619.731664:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 120 00000100:00100000:1.0:1787118619.731673:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+8:5615:x1873929544139776:12345-192.168.203.10@tcp:502: 00000100:00100000:1.0:1787118619.731982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+8:5615:x1873929544139776:12345-192.168.203.10@tcp:502: Request processed in 309us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.731990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 120 00000100:00100000:1.0:1787118619.734890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.734973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544139904 00000100:00100000:3.0:1787118619.734981:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544139904 00000100:00100000:3.0:1787118619.735028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:3.0:1787118619.735038:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+8:5597:x1873929544139904:12345-192.168.203.10@tcp:101: 00010000:00010000:3.0:1787118619.735062:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118619.735078:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8de00/0xaa534e3c784f8518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b823 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.735104:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8de00/0xaa534e3c784f8518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b823 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.735177:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8de00/0xaa534e3c784f8518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b823 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118619.735187:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8de00, rc 0) 00000100:00100000:3.0:1787118619.735241:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+9:5597:x1873929544139904:12345-192.168.203.10@tcp:101: Request processed in 205us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118619.735248:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:2.0:1787118619.743448:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.743556:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140032 00000100:00100000:3.0:1787118619.743564:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140032 00000100:00100000:3.0:1787118619.743615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:3.0:1787118619.743834:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+9:5597:x1873929544140032:12345-192.168.203.10@tcp:256: 20000000:01000000:3.0:1787118619.743863:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787118619.743885:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787118619.743889:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787118619.743893:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787118619.743895:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787118619.748460:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+9:5597:x1873929544140032:12345-192.168.203.10@tcp:256: Request processed in 4620us (5011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118619.750826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:0.0:1787118619.758844:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.758925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140160 00000100:00100000:1.0:1787118619.758934:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140160 00000100:00100000:1.0:1787118619.758985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 123 00000100:00100000:1.0:1787118619.758995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:5597:x1873929544140160:12345-192.168.203.10@tcp:101: 00010000:00010000:1.0:1787118619.759012:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118619.759028:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b82a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118619.759075:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118619.759087:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118619.759096:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9000, rc 0) 00000100:00100000:1.0:1787118619.759505:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:5597:x1873929544140160:12345-192.168.203.10@tcp:101: Request processed in 511us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.759513:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 123 00000100:00100000:2.0:1787118619.765984:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.766074:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140288 00000100:00100000:1.0:1787118619.766084:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140288 00000100:00100000:1.0:1787118619.766145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 124 00000100:00100000:1.0:1787118619.766155:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5597:x1873929544140288:12345-192.168.203.10@tcp:501: 00000100:00100000:1.0:1787118619.766762:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5597:x1873929544140288:12345-192.168.203.10@tcp:501: Request processed in 606us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.766770:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 124 00000100:00100000:2.0:1787118619.775308:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.775419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140416 00000100:00100000:1.0:1787118619.775430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140416 00000100:00100000:1.0:1787118619.775487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 125 00000100:00100000:1.0:1787118619.775498:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:5597:x1873929544140416:12345-192.168.203.10@tcp:503: 00000100:00100000:1.0:1787118619.775889:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:5597:x1873929544140416:12345-192.168.203.10@tcp:503: Request processed in 392us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.775898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 125 00000100:00100000:2.0:1787118619.779385:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.779897:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140544 00000100:00100000:3.0:1787118619.779907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140544 00000100:00100000:3.0:1787118619.779950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:3.0:1787118619.779959:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:5621:x1873929544140544:12345-192.168.203.10@tcp:502: 00000100:00100000:3.0:1787118619.781077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:5621:x1873929544140544:12345-192.168.203.10@tcp:502: Request processed in 1113us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118619.781088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:2.0:1787118619.783950:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118619.784069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140672 00000100:00100000:3.0:1787118619.784078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140672 00000100:00100000:3.0:1787118619.784241:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 127 00000100:00100000:3.0:1787118619.784251:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5621:x1873929544140672:12345-192.168.203.10@tcp:502: 00000100:00100000:3.0:1787118619.784479:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5621:x1873929544140672:12345-192.168.203.10@tcp:502: Request processed in 228us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118619.784486:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 127 00000100:00100000:0.0:1787118619.788924:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118619.789006:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140800 00000100:00100000:1.0:1787118619.789027:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140800 00000100:00100000:1.0:1787118619.789083:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:1.0:1787118619.789092:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2367:x1873929544140800:12345-192.168.203.10@tcp:38: 00010000:00080000:1.0:1787118619.789131:0:7892:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1787118619.789183:0:7892:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f8526 00000004:00100000:1.0:1787118619.789214:0:7892:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787118619.789220:0:7892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787118619.835575:0:7892:0:(import.c:65:import_set_state_nolock()) ffff96137a3d3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118619.835655:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544140800:12345-192.168.203.10@tcp:38: Request processed in 46561us (46737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118619.835665:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00010000:00010000:3.0:1787118620.425920:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118620.843025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118620.843078:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118620.843145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141056 00000100:00100000:2.0:1787118620.843155:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141056 00000100:00100000:2.0:1787118620.843236:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544140928 00000100:00100000:2.0:1787118620.843240:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544140928 00000100:00100000:2.0:1787118620.843271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:2.0:1787118620.843282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:5597:x1873929544141056:12345-192.168.203.10@tcp:41: 00000004:00000024:2.0:1787118620.843333:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118620.843393:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:5597:x1873929544141056:12345-192.168.203.10@tcp:41: Request processed in 113us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118620.843400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:2.0:1787118620.843419:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:2.0:1787118620.843427:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:0:x1873929544140928:12345-192.168.203.10@tcp:41: 00000004:00000024:2.0:1787118620.843438:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118620.843460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:0:x1873929544140928:12345-192.168.203.10@tcp:41: Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118620.843467:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00080000:0.0:1787118620.843770:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118620.848252:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118620.848349:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141184 00000100:00100000:2.0:1787118620.848358:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141184 00000100:00100000:2.0:1787118620.848418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:2.0:1787118620.848429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:5597:x1873929544141184:12345-192.168.203.10@tcp:40: 00000100:00100000:2.0:1787118620.848522:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:5597:x1873929544141184:12345-192.168.203.10@tcp:40: Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118620.848530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:0.0:1787118620.860489:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118620.860543:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118620.860589:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118620.860626:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118620.860758:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141568 00000100:00100000:3.0:1787118620.860766:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141568 00000100:00100000:3.0:1787118620.860820:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 128 00000100:00100000:3.0:1787118620.860831:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544141568:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118620.860901:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544141568:12345-192.168.203.10@tcp:400: Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118620.860909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 128 00000100:00100000:1.0:1787118620.861057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141696 00000100:00100000:1.0:1787118620.861062:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141696 00000100:00100000:1.0:1787118620.861106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:1.0:1787118620.861113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:5597:x1873929544141696:12345-192.168.203.10@tcp:33: 00000100:00100000:2.0:1787118620.866332:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141312 00000100:00100000:2.0:1787118620.866346:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141312 00000100:00100000:2.0:1787118620.866392:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141440 00000100:00100000:2.0:1787118620.866395:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141440 00000100:00100000:2.0:1787118620.866427:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118620.866435:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1873929544141312:12345-192.168.203.10@tcp:8: 00010000:00080000:2.0:1787118620.866524:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1787118620.866554:0:6704:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f852d 00002000:00100000:2.0:1787118620.866565:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b9d85e8-2500-4b81-a525-0303ce911299/ffff96137f871000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787118620.866587:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787118620.866921:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787118620.866950:0:6704:0:(import.c:65:import_set_state_nolock()) ffff96137f872800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118620.867017:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544141312:12345-192.168.203.10@tcp:8: Request processed in 581us (6536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118620.867024:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118620.867390:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:2.0:1787118620.867404:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1873929544141440:12345-192.168.203.10@tcp:8: 00010000:00080000:2.0:1787118620.867449:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1787118620.867497:0:6704:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f8534 00002000:00100000:2.0:1787118620.867504:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b9d85e8-2500-4b81-a525-0303ce911299/ffff96137f873800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787118620.867528:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787118620.867792:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787118620.867811:0:6704:0:(import.c:65:import_set_state_nolock()) ffff96137f873000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118620.867838:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544141440:12345-192.168.203.10@tcp:8: Request processed in 433us (7211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118620.883282:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000004:00080000:3.0:1787118620.902604:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41407us 00000004:00200000:1.0:1787118620.943482:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787118620.943665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:5597:x1873929544141696:12345-192.168.203.10@tcp:33: Request processed in 82546us (83069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118620.943676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000001:00100000:3.0:1787118621.100741:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00010000:00010000:3.0:1787118621.450076:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118621.483984:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118621.484120:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141824 00000100:00100000:2.0:1787118621.484131:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141824 00000100:00100000:2.0:1787118621.484218:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118621.484263:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:5638:x1873929544141824:12345-192.168.203.10@tcp:101: 00010000:00010000:2.0:1787118621.484282:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118621.484330:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382175200/0xaa534e3c784f853b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b854 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484396:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484408:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484421:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118621.484840:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787118621.484845:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118621.484923:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484950:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382175200/0xaa534e3c784f853b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b854 expref: 8 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484967:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b854 expref: 7 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118621.484977:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118621.484980:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118621.484983:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382175c00, rc 0) 00000100:00100000:2.0:1787118621.485104:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:5638:x1873929544141824:12345-192.168.203.10@tcp:101: Request processed in 844us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118621.485135:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00010000:00010000:3.0:1787118622.475686:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118622.540086:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566183808:0@lo:400: 00000100:00100000:0.0:1787118622.540298:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566183424:0@lo:400: 00000100:00100000:0.0:1787118622.540342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118622.540393:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566183936:0@lo:400: 00000100:00100000:0.0:1787118622.540420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118622.540453:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787118622.540461:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566183552:0@lo:400: 00000100:00100000:0.0:1787118622.540485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118622.540517:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566184064:0@lo:400: 00000100:00100000:0.0:1787118622.540543:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118622.540586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183936 00000100:00100000:0.0:1787118622.540593:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183936 00000100:00100000:0.0:1787118622.540641:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183552 00000100:00100000:0.0:1787118622.540644:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183552 00000100:00100000:0.0:1787118622.540664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787118622.540672:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566183936:12345-0@lo:400: 00000100:00100000:0.0:1787118622.540760:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566183936:12345-0@lo:400: Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118622.540768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787118622.540788:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787118622.540794:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566183552:12345-0@lo:400: 00000100:00100000:0.0:1787118622.540821:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566183552:12345-0@lo:400: Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118622.540826:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787118622.540842:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118622.540871:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566183552:0@lo:400: 00000100:00100000:0.0:1787118622.540882:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566183936:0@lo:400: 00000100:00100000:3.0:1787118622.541074:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566183680:0@lo:400: 00000100:00100000:3.0:1787118622.541113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118622.541150:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183424 00000100:00100000:3.0:1787118622.541154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183424 00000100:00100000:3.0:1787118622.541193:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787118622.541199:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566183424:12345-0@lo:400: 00000100:00100000:3.0:1787118622.541236:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566183424:12345-0@lo:400: Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118622.541243:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787118622.541268:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184064 00000100:00100000:3.0:1787118622.541272:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184064 00000100:00100000:3.0:1787118622.541298:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787118622.541305:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566184064:12345-0@lo:400: 00000100:00100000:3.0:1787118622.541334:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566184064:12345-0@lo:400: Request processed in 30us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118622.541340:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787118622.541360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183680 00000100:00100000:3.0:1787118622.541363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183680 00000100:00100000:3.0:1787118622.541381:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118622.541395:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566183680:12345-0@lo:400: 00000100:00100000:3.0:1787118622.541442:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566183680:12345-0@lo:400: Request processed in 48us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118622.541449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118622.541474:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566183680:0@lo:400: 00000100:00100000:1.0:1787118622.541809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118622.541889:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566183808 00000100:00100000:2.0:1787118622.541894:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566183808 00000100:00100000:2.0:1787118622.541928:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787118622.541940:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566183808:12345-0@lo:400: 00000100:00100000:2.0:1787118622.541986:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566183808:12345-0@lo:400: Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118622.541992:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787118622.542445:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118622.542450:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787118622.542452:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787118622.542479:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa65500 x1873929566184064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118622.542490:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787118622.542621:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566184064:0@lo:400: 00000100:00100000:0.0:1787118622.542636:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566183424:0@lo:400: 00010000:00080000:1.0:1787118622.542736:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa64380 x1873929566183808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118622.542748:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566183808:0@lo:400: 00000100:00100000:0.0:1787118623.053441:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566184192:0@lo:13: 00000100:00100000:0.0:1787118623.053517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118623.053654:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184192 00000100:00100000:2.0:1787118623.053663:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184192 00000100:00100000:2.0:1787118623.053743:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787118623.053754:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566184192:12345-0@lo:13: 00002000:00000024:2.0:1787118623.053823:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118623.053875:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566184192:12345-0@lo:13: Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118623.053882:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787118623.054044:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375be8000 x1873929566184192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118623.054063:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566184192:0@lo:13: 00010000:00010000:3.0:1787118623.498089:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118623.562022:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566184320:0@lo:13: 00000100:00100000:1.0:1787118623.562101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118623.562333:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184320 00000100:00100000:3.0:1787118623.562342:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184320 00000100:00100000:3.0:1787118623.562393:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787118623.562401:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566184320:12345-0@lo:13: 00002000:00000024:3.0:1787118623.562435:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118623.562878:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566184320:12345-0@lo:13: Request processed in 477us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118623.562886:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787118623.562955:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1180 x1873929566184320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118623.562971:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566184320:0@lo:13: 00000100:00100000:0.0:1787118624.118660:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118624.118793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544141952 00000100:00100000:3.0:1787118624.118804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544141952 00000100:00100000:3.0:1787118624.118882:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:3.0:1787118624.118893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:5690:x1873929544141952:12345-192.168.203.10@tcp:41: 00000004:00000024:3.0:1787118624.118934:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787118624.118992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:5690:x1873929544141952:12345-192.168.203.10@tcp:41: Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118624.118999:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00080000:0.0:1787118624.119685:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118624.142446:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118624.147664:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142080 00000100:00100000:2.0:1787118624.147678:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142080 00000100:00100000:2.0:1787118624.147794:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:2.0:1787118624.147805:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b9d85e8-2500-4b81-a525-0303ce911299+5:5690:x1873929544142080:12345-192.168.203.10@tcp:13: 00002000:00000024:2.0:1787118624.147829:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118624.148211:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b9d85e8-2500-4b81-a525-0303ce911299+5:5690:x1873929544142080:12345-192.168.203.10@tcp:13: Request processed in 407us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118624.148219:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00080000:0.0:1787118624.150000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118624.155144:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118624.161041:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142208 00000100:00100000:2.0:1787118624.161054:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142208 00000100:00100000:2.0:1787118624.161165:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118624.161177:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b9d85e8-2500-4b81-a525-0303ce911299+6:5690:x1873929544142208:12345-192.168.203.10@tcp:13: 00002000:00000024:2.0:1787118624.161202:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118624.161279:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4b9d85e8-2500-4b81-a525-0303ce911299+6:5690:x1873929544142208:12345-192.168.203.10@tcp:13: Request processed in 104us (6142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118624.161287:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00080000:0.0:1787118624.161680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787118624.521900:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787118625.201804:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000001:00100000:3.0:1787118625.225895:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00010000:00010000:3.0:1787118625.548819:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118626.007840:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118626.007884:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118626.007910:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118626.007933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118626.007960:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142592 00000100:00100000:0.0:1787118626.007968:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142592 00000100:00100000:0.0:1787118626.008033:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142720 00000100:00100000:0.0:1787118626.008036:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142720 00000100:00100000:0.0:1787118626.008056:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118626.008066:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544142592:12345-192.168.203.10@tcp:400: 00000100:00100000:0.0:1787118626.008133:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544142592:12345-192.168.203.10@tcp:400: Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118626.008140:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118626.008156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118626.008162:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544142720:12345-192.168.203.10@tcp:400: 00000100:00100000:0.0:1787118626.008187:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544142720:12345-192.168.203.10@tcp:400: Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118626.008193:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118626.008209:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142464 00000100:00100000:0.0:1787118626.008213:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142464 00000100:00100000:0.0:1787118626.008240:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:0.0:1787118626.008247:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544142464:12345-192.168.203.10@tcp:400: 00000100:00100000:0.0:1787118626.008273:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544142464:12345-192.168.203.10@tcp:400: Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118626.008278:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00080000:0.0:1787118626.008311:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787118626.008315:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118626.008317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118626.008462:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142336 00000100:00100000:3.0:1787118626.008467:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142336 00000100:00100000:3.0:1787118626.008564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 130 00000100:00100000:3.0:1787118626.008574:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544142336:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118626.008613:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544142336:12345-192.168.203.10@tcp:400: Request processed in 40us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118626.008619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 130 00010000:00010000:3.0:1787118626.571959:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118627.593926:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118627.672289:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566184448:0@lo:400: 00000100:00100000:2.0:1787118627.672394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118627.673397:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566184960:0@lo:400: 00000100:00100000:2.0:1787118627.673460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118627.673674:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787118627.673683:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566184576:0@lo:400: 00000100:00100000:2.0:1787118627.673714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118627.673754:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566185088:0@lo:400: 00000100:00100000:2.0:1787118627.673782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118627.673828:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566184704:0@lo:400: 00000100:00100000:2.0:1787118627.673854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118627.673881:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118627.673889:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566184832:0@lo:400: 00000100:00100000:2.0:1787118627.673930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118627.673969:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184960 00000100:00100000:2.0:1787118627.673976:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184448 00000100:00100000:3.0:1787118627.673980:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184960 00000100:00100000:2.0:1787118627.673983:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184448 00000100:00100000:3.0:1787118627.674061:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184576 00000100:00100000:2.0:1787118627.674064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787118627.674066:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184576 00000100:00100000:2.0:1787118627.674080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566184448:12345-0@lo:400: 00000100:00100000:3.0:1787118627.674085:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184704 00000100:00100000:3.0:1787118627.674089:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184704 00000100:00100000:3.0:1787118627.674108:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787118627.674117:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566184960:12345-0@lo:400: 00000100:00100000:2.0:1787118627.674154:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566184448:12345-0@lo:400: Request processed in 77us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118627.674170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787118627.674174:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566184960:12345-0@lo:400: Request processed in 56us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118627.674184:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787118627.674202:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787118627.674211:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566184576:12345-0@lo:400: 00000100:00100000:2.0:1787118627.674219:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118627.674231:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566184704:12345-0@lo:400: 00000100:00100000:3.0:1787118627.674245:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566184576:12345-0@lo:400: Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118627.674252:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787118627.674274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118627.674280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566184704:12345-0@lo:400: Request processed in 52us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118627.674291:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118627.674331:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185088 00000100:00100000:2.0:1787118627.674334:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185088 00000100:00100000:2.0:1787118627.674373:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566184832 00000100:00100000:2.0:1787118627.674376:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566184832 00000100:00100000:2.0:1787118627.674392:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787118627.674398:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566185088:12345-0@lo:400: 00000100:00100000:2.0:1787118627.674430:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566185088:12345-0@lo:400: Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118627.674436:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787118627.674448:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118627.674456:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566184832:12345-0@lo:400: 00000100:00100000:2.0:1787118627.678859:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566184832:12345-0@lo:400: Request processed in 4391us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118627.678878:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118627.678974:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566184576:0@lo:400: 00010000:00080000:2.0:1787118627.678995:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1880 x1873929566185088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118627.679018:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566185088:0@lo:400: 00000100:00100000:2.0:1787118627.679032:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566184448:0@lo:400: 00000100:00100000:2.0:1787118627.679063:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566184960:0@lo:400: 00010000:00080000:2.0:1787118627.679118:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1180 x1873929566184832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118627.679129:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566184832:0@lo:400: 00000100:00100000:2.0:1787118627.679141:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566184704:0@lo:400: 00000100:00080000:3.0:1787118627.682841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118627.682854:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787118628.158917:0:8307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787118628.185158:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566185216:0@lo:13: 00000100:00100000:2.0:1787118628.185265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118628.185583:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185216 00000100:00100000:0.0:1787118628.185596:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185216 00000100:00100000:0.0:1787118628.185677:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118628.185689:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566185216:12345-0@lo:13: 00002000:00000024:0.0:1787118628.185771:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118628.185898:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566185216:12345-0@lo:13: Request processed in 210us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118628.185906:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787118628.186085:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f73c700 x1873929566185216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118628.186106:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566185216:0@lo:13: 00010000:00010000:3.0:1787118628.619034:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118628.683266:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787118628.683318:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566185344:0@lo:13: 00000100:00100000:1.0:1787118628.683420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118628.683494:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185344 00000100:00100000:2.0:1787118628.683507:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185344 00000100:00100000:2.0:1787118628.683573:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787118628.683584:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566185344:12345-0@lo:13: 00002000:00000024:2.0:1787118628.683618:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118628.683742:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566185344:12345-0@lo:13: Request processed in 138us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118628.683754:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787118628.683863:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375ebbb80 x1873929566185344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118628.683891:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566185344:0@lo:13: 00010000:00010000:2.0:1787118629.654339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118630.665848:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118631.142779:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118631.142824:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118631.142856:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118631.142865:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143104 00000100:00100000:1.0:1787118631.142875:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143104 00000100:00100000:0.0:1787118631.142898:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118631.142933:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143232 00000100:00100000:2.0:1787118631.142938:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142976 00000100:00100000:1.0:1787118631.142938:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143232 00000100:00100000:2.0:1787118631.142945:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142976 00000100:00100000:0.0:1787118631.142960:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:2.0:1787118631.143011:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:3.0:1787118631.143018:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544142848 00000100:00100000:3.0:1787118631.143024:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544142848 00000100:00100000:2.0:1787118631.143029:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544142976:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118631.143057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 132 00000100:00100000:3.0:1787118631.143078:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544142848:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118631.143151:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544142848:12345-192.168.203.10@tcp:400: Request processed in 74us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118631.143158:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 132 00000100:00100000:2.0:1787118631.143179:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544142976:12345-192.168.203.10@tcp:400: Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118631.143189:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00080000:3.0:1787118631.143190:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118631.143195:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118631.143200:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118631.143225:0:6704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787118631.143234:0:6704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787118631.143365:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544143104:12345-192.168.203.10@tcp:400: 00000100:00100000:0.0:1787118631.143400:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544143104:12345-192.168.203.10@tcp:400: Request processed in 430us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.147490:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:1.0:1787118631.147516:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544143232:12345-192.168.203.10@tcp:400: 00000100:00100000:1.0:1787118631.147626:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544143232:12345-192.168.203.10@tcp:400: Request processed in 122us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.147635:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:0.0:1787118631.150884:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00010000:00010000:2.0:1787118631.691262:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787118631.791026:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe22987810 20000000:00000080:2.0:1787118631.791042:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96137a6f9000 uarg=0000000000000000 20000000:01000000:2.0:1787118631.791367:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787118631.791370:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787118631.791373:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787118631.791377:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787118631.791381:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787118631.791394:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787118631.791396:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787118631.791877:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787118631.791880:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787118631.794649:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787118631.795651:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787118631.796181:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787118631.796230:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787118631.796686:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787118631.796689:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787118631.798228:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787118631.803333:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787118631.803382:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787118631.803426:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787118631.803441:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787118631.803444:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787118631.805243:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787118631.806430:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787118631.806613:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787118631.806652:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787118631.806667:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787118631.806670:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787118631.810384:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787118631.811718:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787118631.811968:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787118631.812021:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787118631.812038:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787118631.812057:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812317:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f843f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812340:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812346:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812353:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812360:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84af expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812367:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812374:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812383:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812390:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812397:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812435:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.812461:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 9 pid: 5836 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.812656:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185472:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118631.821410:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.821456:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823019:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185600:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118631.823125:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823137:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 18 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823149:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185728:0@lo:104: 00000100:00100000:0.0:1787118631.823180:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118631.823213:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823221:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823229:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185856:0@lo:104: 00000100:00100000:0.0:1787118631.823258:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118631.823278:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823286:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823294:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185984:0@lo:104: 00010000:00010000:0.0:1787118631.823311:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823327:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 18 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823336:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186112:0@lo:104: 00010000:00010000:0.0:1787118631.823365:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823372:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823379:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186240:0@lo:104: 00010000:00010000:0.0:1787118631.823397:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823404:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 18 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823412:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186368:0@lo:104: 00010000:00010000:0.0:1787118631.823432:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.823449:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 18 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.823458:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186496:0@lo:104: 00000100:00100000:1.0:1787118631.823785:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787118631.823804:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118631.823816:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118631.823825:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118631.823832:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118631.823840:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118631.823849:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185728 00000100:00100000:1.0:1787118631.823854:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185728 00000100:00100000:1.0:1787118631.823890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185856 00000100:00100000:1.0:1787118631.823893:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185856 00000100:00100000:1.0:1787118631.823904:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566185984 00000100:00100000:1.0:1787118631.823907:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566185984 00000100:00100000:1.0:1787118631.823916:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186112 00000100:00100000:1.0:1787118631.823918:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186112 00000100:00100000:1.0:1787118631.823927:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186240 00000100:00100000:1.0:1787118631.823929:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186240 00000100:00100000:1.0:1787118631.823938:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186368 00000100:00100000:1.0:1787118631.823940:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186368 00000100:00100000:1.0:1787118631.823949:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186496 00000100:00100000:1.0:1787118631.823952:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186496 00000100:00100000:1.0:1787118631.823964:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787118631.823981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:8457:x1873929566185728:12345-0@lo:104: 00010000:00010000:1.0:1787118631.823992:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824044:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118631.824049:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+9:8457:x1873929566185728:12345-0@lo:104: Request processed in 79us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824056:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787118631.824086:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787118631.824093:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f644050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+8:8457:x1873929566185856:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824107:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824138:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787118631.824143:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f644050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+8:8457:x1873929566185856:12345-0@lo:104: Request processed in 51us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824149:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787118631.824181:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118631.824188:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:8457:x1873929566185984:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824195:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824221:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787118631.824226:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+7:8457:x1873929566185984:12345-0@lo:104: Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824232:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118631.824244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118631.824269:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:8457:x1873929566186112:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824276:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824301:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787118631.824306:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+6:8457:x1873929566186112:12345-0@lo:104: Request processed in 39us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118631.824323:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787118631.824329:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:8457:x1873929566186240:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824341:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824368:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787118631.824374:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:8457:x1873929566186240:12345-0@lo:104: Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824380:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787118631.824392:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787118631.824398:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:8457:x1873929566186368:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824405:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824429:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787118631.824446:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:8457:x1873929566186368:12345-0@lo:104: Request processed in 37us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824452:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787118631.824463:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787118631.824468:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:8457:x1873929566186496:12345-0@lo:104: 00010000:00010000:1.0:1787118631.824484:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.824954:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787118631.824959:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:8457:x1873929566186496:12345-0@lo:104: Request processed in 491us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.824965:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787118631.825000:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787118631.825006:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.825019:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ca00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118631.825023:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.825031:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118631.825037:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118631.825043:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787118631.825155:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787118631.825178:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185728:0@lo:104: 00000100:00100000:0.0:1787118631.825187:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185856:0@lo:104: 00000100:00100000:0.0:1787118631.825204:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185984:0@lo:104: 00000100:00100000:0.0:1787118631.825213:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186112:0@lo:104: 00000100:00100000:0.0:1787118631.825220:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186240:0@lo:104: 00000100:00100000:0.0:1787118631.825227:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186368:0@lo:104: 00000100:00100000:0.0:1787118631.825234:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566186496:0@lo:104: 00010000:00010000:2.0:1787118631.825417:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787118631.825596:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787118631.825603:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.825611:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174a00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118631.825614:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.825621:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118631.825628:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118631.825634:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118631.825660:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.825668:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118631.825685:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.825692:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f84cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.825717:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787118631.826231:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826240:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118631.826257:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826264:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f84ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826275:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787118631.826278:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826283:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118631.826286:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826303:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118631.826309:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118631.826315:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118631.826329:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826335:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118631.826350:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826356:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f8493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f849a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826364:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118631.826367:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826372:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118631.826374:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826380:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118631.826385:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118631.826395:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787118631.826406:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826412:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118631.826417:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.826423:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8c600/0xaa534e3c784f8469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8470 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826506:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826515:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118631.826518:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826525:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118631.826532:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118631.826537:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118631.826552:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826559:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118631.826563:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826570:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382042400/0xaa534e3c784f84a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826579:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118631.826583:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826598:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174800 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118631.826600:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826606:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118631.826611:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118631.826615:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118631.826630:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826635:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118631.826639:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826645:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f843f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8446 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.826654:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.826655:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.826657:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118631.826682:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566186624:0@lo:103: 00000100:00100000:2.0:1787118631.826755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118631.826801:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566187136:0@lo:103: 00000100:00100000:2.0:1787118631.826822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118631.826854:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787118631.826860:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566186752:0@lo:103: 00000100:00100000:2.0:1787118631.826880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118631.826895:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566187264:0@lo:103: 00000100:00100000:2.0:1787118631.826913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118631.826939:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186624 00000100:00100000:2.0:1787118631.826944:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186624 00010000:00010000:2.0:1787118631.826981:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 19 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.826998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187136 00000100:00100000:2.0:1787118631.827001:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187136 00010000:00010000:2.0:1787118631.827013:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 20 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.827023:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186752 00000100:00100000:2.0:1787118631.827025:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186752 00010000:00010000:2.0:1787118631.827036:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 21 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.827045:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187264 00000100:00100000:2.0:1787118631.827047:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187264 00010000:00010000:2.0:1787118631.827056:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 22 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.827079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118631.827089:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+22:3300:x1873929566186624:12345-0@lo:103: 00010000:00010000:2.0:1787118631.827100:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118631.827106:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 22 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.827124:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 22 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.827137:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8d800/0xaa534e3c784f84d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f84cb expref: 22 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.827149:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118631.827181:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3300:x1873929566186624:12345-0@lo:103: Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118631.827885:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566187008:0@lo:103: 00000100:00100000:0.0:1787118631.827919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118631.827938:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118631.827944:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566186880:0@lo:103: 00000100:00100000:0.0:1787118631.827962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118631.828162:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118631.828165:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118631.828167:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118631.828178:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.828186:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787118631.828209:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.828214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187008 00000100:00100000:1.0:1787118631.828218:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187008 00010000:00010000:1.0:1787118631.828235:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 22 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.828330:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118631.828350:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566186880 00000100:00100000:2.0:1787118631.828353:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566186880 00010000:00010000:2.0:1787118631.828369:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 22 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.828381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787118631.828386:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+22:3300:x1873929566187136:12345-0@lo:103: 00010000:00010000:2.0:1787118631.828396:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118631.828400:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 22 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.828409:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 22 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.828422:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042800/0xaa534e3c784f84a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f84a1 expref: 22 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.828434:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118631.828461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3300:x1873929566187136:12345-0@lo:103: Request processed in 75us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.828623:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.828632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118631.828639:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3300:x1873929566186752:12345-0@lo:103: 00010000:00010000:1.0:1787118631.828647:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118631.828652:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 21 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.828659:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 21 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.828802:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042000/0xaa534e3c784f84f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f84ee expref: 21 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.828811:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118631.828838:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3300:x1873929566186752:12345-0@lo:103: Request processed in 200us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.828845:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118631.828858:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.828864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118631.828869:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566187264:12345-0@lo:103: 00010000:00010000:1.0:1787118631.828877:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118631.828881:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.828889:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.832226:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787118631.834006:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382043200/0xaa534e3c784f8446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f843f expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.834031:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118631.834174:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787118631.834192:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118631.834211:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3299:x1873929566187008:12345-0@lo:103: 00010000:00010000:2.0:1787118631.834229:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118631.834236:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 17 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118631.834520:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3300:x1873929566187264:12345-0@lo:103: Request processed in 5649us (7604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.834527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118631.834546:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.834553:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787118631.834561:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3299:x1873929566186880:12345-0@lo:103: 00010000:00010000:1.0:1787118631.834569:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118631.834586:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 16 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.834820:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 16 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118631.835401:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118631.837078:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185472:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118631.837678:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 16 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.837699:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042c00/0xaa534e3c784f849a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8493 expref: 16 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.837712:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118631.838101:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3299:x1873929566186880:12345-0@lo:103: Request processed in 3540us (10135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.838112:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787118631.838141:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.838150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143360 00000100:00100000:1.0:1787118631.838156:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143360 00010000:00010000:1.0:1787118631.838178:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 10 pid: 5836 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118631.838203:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787118631.838212:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:1.0:1787118631.838220:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350046c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544143360:12345-192.168.203.10@tcp:103: 00010000:00010000:1.0:1787118631.838232:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118631.838237:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 10 pid: 5836 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118631.838426:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566186880:0@lo:103: 00010000:00010000:1.0:1787118631.838470:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 10 pid: 5836 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.838595:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f8511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f9 expref: 10 pid: 5836 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118631.838620:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118631.838699:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350046c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+9:2369:x1873929544143360:12345-192.168.203.10@tcp:103: Request processed in 479us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118631.838707:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00010000:00010000:2.0:1787118631.838893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042e00/0xaa534e3c784f8470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8469 expref: 14 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.838904:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118631.838948:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3299:x1873929566187008:12345-0@lo:103: Request processed in 4747us (11028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118631.838954:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118631.839013:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566186752:0@lo:103: 00000100:00100000:2.0:1787118631.839024:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566187264:0@lo:103: 00000100:00100000:2.0:1787118631.839032:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566186624:0@lo:103: 00000100:00100000:2.0:1787118631.839039:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566187136:0@lo:103: 00000100:00100000:1.0:1787118631.839434:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566187008:0@lo:103: 00010000:00010000:2.0:1787118631.839912:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.839920:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.839943:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118631.839947:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.839954:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118631.839961:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118631.839968:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118631.840018:0:8462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840025:0:8462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118631.840045:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840052:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8d600/0xaa534e3c784f84af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f84b6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840076:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.840078:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.840080:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.840086:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118631.840087:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118631.840422:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566187392:0@lo:103: 00000100:00100000:1.0:1787118631.840480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118631.840664:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187392 00000100:00100000:2.0:1787118631.840679:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187392 00010000:00010000:2.0:1787118631.840703:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 13 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118631.840782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787118631.840792:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:3298:x1873929566187392:12345-0@lo:103: 00010000:00010000:2.0:1787118631.840803:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118631.840808:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 13 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840817:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 13 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840831:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f84b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f84af expref: 13 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118631.840843:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118631.840884:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3298:x1873929566187392:12345-0@lo:103: Request processed in 95us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118631.840891:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787118631.844429:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566187392:0@lo:103: 00000100:00100000:1.0:1787118631.855027:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118631.855200:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873929566185600:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118631.855263:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118631.856422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143488 00000100:00100000:3.0:1787118631.856431:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143488 00010000:00010000:3.0:1787118631.856484:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118631.856628:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:3.0:1787118631.856638:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+9:2368:x1873929544143488:12345-192.168.203.10@tcp:103: 00010000:00010000:3.0:1787118631.856650:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118631.856656:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856677:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856712:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8da00/0xaa534e3c784f850a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b7f2 expref: 9 pid: 5834 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856859:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856868:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856883:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856889:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856897:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856903:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856909:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382175200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118631.856913:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856919:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856930:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118631.856947:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118631.857005:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+8:2368:x1873929544143488:12345-192.168.203.10@tcp:103: Request processed in 369us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118631.857013:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00010000:00010000:0.0:1787118631.859280:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.859296:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118631.859303:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382175200/0xaa534e3c784f8549 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118632.713854:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118632.778128:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566187776:0@lo:400: 00000100:00100000:2.0:1787118632.778129:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566187648:0@lo:400: 00000100:00100000:0.0:1787118632.778200:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566187904:0@lo:400: 00000100:00100000:1.0:1787118632.778270:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566187520:0@lo:400: 00000100:00100000:3.0:1787118632.784820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118632.784914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187776 00000100:00100000:3.0:1787118632.784922:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187776 00000100:00100000:3.0:1787118632.784987:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787118632.786374:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566187776:12345-0@lo:400: 00000100:00100000:3.0:1787118632.786858:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566187776:12345-0@lo:400: Request processed in 1860us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118632.786868:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787118632.786901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118632.786941:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566187776:0@lo:400: 00000100:00100000:0.0:1787118632.789099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118632.789526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118632.789564:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566188160:0@lo:400: 00000100:00100000:2.0:1787118632.789595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118632.789640:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187904 00000100:00100000:2.0:1787118632.789647:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187904 00000100:00100000:2.0:1787118632.789700:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188160 00000100:00100000:2.0:1787118632.789703:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188160 00000100:00100000:2.0:1787118632.789742:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787118632.789752:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566187904:12345-0@lo:400: 00000100:00100000:2.0:1787118632.789811:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566187904:12345-0@lo:400: Request processed in 62us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118632.789818:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787118632.789832:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118632.789839:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566188160:12345-0@lo:400: 00000100:00080000:3.0:1787118632.789973:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118632.789977:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118632.790034:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187648 00000100:00100000:0.0:1787118632.790038:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187648 00000100:00100000:0.0:1787118632.790070:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787118632.790078:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566187648:12345-0@lo:400: 00000100:00100000:0.0:1787118632.790116:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566187648:12345-0@lo:400: Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118632.790123:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787118632.790156:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375beb480 x1873929566187904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118632.790169:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566187904:0@lo:400: 00000100:00100000:3.0:1787118632.790349:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566187648:0@lo:400: 00000100:00100000:2.0:1787118632.791740:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566188160:12345-0@lo:400: Request processed in 1884us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118632.791751:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787118632.794075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118632.794131:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566188032:0@lo:400: 00000100:00100000:1.0:1787118632.794167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787118632.794991:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375beaa00 x1873929566188160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118632.795007:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566188160:0@lo:400: 00000100:00100000:2.0:1787118632.795089:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566187520 00000100:00100000:2.0:1787118632.795095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566187520 00000100:00100000:2.0:1787118632.795155:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787118632.795165:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3299:x1873929566187520:12345-0@lo:400: 00000100:00100000:2.0:1787118632.795241:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:3299:x1873929566187520:12345-0@lo:400: Request processed in 78us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118632.795248:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787118632.795466:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566187520:0@lo:400: 00000100:00100000:0.0:1787118632.795940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188032 00000100:00100000:0.0:1787118632.795946:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188032 00000100:00100000:0.0:1787118632.796014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787118632.796022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566188032:12345-0@lo:400: 00000100:00100000:0.0:1787118632.796075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566188032:12345-0@lo:400: Request processed in 53us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118632.796084:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787118632.796156:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566188032:0@lo:400: 00000100:00080000:3.0:1787118632.796312:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118633.290242:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566188288:0@lo:13: 00000100:00100000:3.0:1787118633.290333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.290506:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188288 00000100:00100000:2.0:1787118633.290514:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188288 00000100:00100000:2.0:1787118633.290595:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787118633.290606:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566188288:12345-0@lo:13: 00002000:00000024:2.0:1787118633.290641:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118633.295681:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566188288:12345-0@lo:13: Request processed in 5066us (5337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.295697:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787118633.295839:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351520a80 x1873929566188288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118633.296125:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566188288:0@lo:13: 10000000:01000000:2.0:1787118633.354207:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787118633.354215:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96137a707800 from 39 10000000:01000000:2.0:1787118633.354221:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787118633.354267:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.354291:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.354304:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.354326:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188416:0@lo:101: 00000100:00100000:2.0:1787118633.354391:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.354471:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.355126:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188416 00000100:00100000:3.0:1787118633.355134:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188416 00000100:00100000:3.0:1787118633.355189:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787118633.355198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+12:5838:x1873929566188416:12345-0@lo:101: 00010000:00010000:3.0:1787118633.355210:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118633.355224:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8c800/0xaa534e3c784f8557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8550 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.355246:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8c800/0xaa534e3c784f8557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8550 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.355256:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8c800/0xaa534e3c784f8557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8550 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.355265:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c800, rc 0) 00000100:00100000:3.0:1787118633.355321:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566188416:12345-0@lo:101: Request processed in 124us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.355328:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787118633.355418:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188416:0@lo:101: 00010000:00010000:0.0:1787118633.355444:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118633.355452:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118633.355508:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188544:0@lo:501: 00000100:00100000:0.0:1787118633.355545:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.355577:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.355903:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188544 00000100:00100000:3.0:1787118633.355908:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188544 00000100:00100000:3.0:1787118633.355943:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787118633.355951:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566188544:12345-0@lo:501: 00000100:00100000:3.0:1787118633.356269:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566188544:12345-0@lo:501: Request processed in 318us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.356276:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787118633.358982:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188544:0@lo:501: 00000100:00100000:1.0:1787118633.359207:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188672:0@lo:503: 00000100:00100000:1.0:1787118633.359273:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118633.359317:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.359376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188672 00000100:00100000:3.0:1787118633.359382:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188672 00000100:00100000:3.0:1787118633.359436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787118633.359444:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566188672:12345-0@lo:503: 00000100:00100000:3.0:1787118633.359920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566188672:12345-0@lo:503: Request processed in 475us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.359927:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787118633.361164:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566188672:0@lo:503: 00000100:00100000:1.0:1787118633.363321:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8476:1873929566188800:0@lo:502: 00000100:00100000:1.0:1787118633.363396:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118633.363451:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118633.363555:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188800 00000100:00100000:0.0:1787118633.363562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188800 00000100:00100000:0.0:1787118633.363624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787118633.363634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:8476:x1873929566188800:12345-0@lo:502: 00000100:00100000:0.0:1787118633.363888:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:8476:x1873929566188800:12345-0@lo:502: Request processed in 256us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.363896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787118633.365229:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8476:1873929566188800:0@lo:502: 00000100:00100000:1.0:1787118633.365293:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8476:1873929566188928:0@lo:502: 00000100:00100000:1.0:1787118633.365348:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118633.365397:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.374049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566188928 00000100:00100000:3.0:1787118633.374063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566188928 00000100:00100000:3.0:1787118633.374125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787118633.374136:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:8476:x1873929566188928:12345-0@lo:502: 00000100:00100000:3.0:1787118633.374425:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:8476:x1873929566188928:12345-0@lo:502: Request processed in 290us (9075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.374433:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787118633.375977:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8476:1873929566188928:0@lo:502: 00000040:00080000:1.0:1787118633.376029:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787118633.376293:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787118633.376314:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787118633.376323:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.376333:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118633.376342:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787118633.376344:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787118633.376347:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787118633.376381:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.376388:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.376397:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.376443:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189056:0@lo:101: 00000100:00100000:2.0:1787118633.376507:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.376553:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.377761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189056 00000100:00100000:1.0:1787118633.377772:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189056 00000100:00100000:1.0:1787118633.377819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787118633.377828:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+13:5838:x1873929566189056:12345-0@lo:101: 00010000:00010000:1.0:1787118633.377842:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118633.377856:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f8565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f855e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.377879:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f8565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f855e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.377889:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f8565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f855e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.377897:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8e00, rc 0) 00000100:00100000:1.0:1787118633.377952:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189056:12345-0@lo:101: Request processed in 124us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118633.377971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787118633.378170:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189056:0@lo:101: 00010000:00010000:2.0:1787118633.378186:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.378195:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.378254:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189184:0@lo:501: 00000100:00100000:2.0:1787118633.378286:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.378329:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.378986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189184 00000100:00100000:3.0:1787118633.378993:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189184 00000100:00100000:3.0:1787118633.379048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787118633.379057:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189184:12345-0@lo:501: 00000100:00100000:3.0:1787118633.379307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189184:12345-0@lo:501: Request processed in 251us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.379315:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787118633.382500:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189184:0@lo:501: 00000100:00100000:0.0:1787118633.382569:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189312:0@lo:503: 00000100:00100000:0.0:1787118633.382663:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.382707:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.382834:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189312 00000100:00100000:2.0:1787118633.382841:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189312 00000100:00100000:2.0:1787118633.382899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787118633.382909:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189312:12345-0@lo:503: 00000100:00100000:2.0:1787118633.383120:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189312:12345-0@lo:503: Request processed in 214us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.383128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787118633.385165:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189312:0@lo:503: 00000100:00100000:0.0:1787118633.387147:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8477:1873929566189440:0@lo:502: 00000100:00100000:0.0:1787118633.387230:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.387275:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.387393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189440 00000100:00100000:2.0:1787118633.387400:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189440 00000100:00100000:2.0:1787118633.387456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787118633.387465:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:8477:x1873929566189440:12345-0@lo:502: 00000100:00100000:2.0:1787118633.387690:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:8477:x1873929566189440:12345-0@lo:502: Request processed in 227us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.387707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787118633.388130:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8477:1873929566189440:0@lo:502: 00000020:01000000:0.0:1787118633.388159:0:8477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118633.388168:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118633.388170:0:8477:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787118633.388175:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787118633.388197:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8477:1873929566189568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118633.388230:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.388267:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.388340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189568 00000100:00100000:1.0:1787118633.388350:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189568 00000100:00100000:1.0:1787118633.388387:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787118633.388394:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:8477:x1873929566189568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118633.388534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:8477:x1873929566189568:12345-0@lo:502:llog_process_th.0 Request processed in 140us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118633.388541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787118633.388832:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8477:1873929566189568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787118633.388857:0:8477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118633.388862:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118633.388864:0:8477:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787118633.388867:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787118633.389037:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787118633.389063:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787118633.389072:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.389083:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118633.389103:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787118633.389105:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961375697800 from 39 10000000:01000000:3.0:1787118633.389108:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787118633.389132:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.389141:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.389150:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118633.389165:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.389196:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.389224:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.389362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189696 00000100:00100000:1.0:1787118633.389367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189696 00000100:00100000:1.0:1787118633.389398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787118633.389406:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:5838:x1873929566189696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118633.389416:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118633.389428:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8400/0xaa534e3c784f8573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f856c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.389458:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8400/0xaa534e3c784f8573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f856c expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.389469:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8400/0xaa534e3c784f8573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f856c expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.389477:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8400, rc 0) 00000100:00100000:1.0:1787118633.389509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566189696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118633.389515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787118633.389810:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118633.389825:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118633.389834:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118633.389881:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.389905:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.389929:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.390111:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189824 00000100:00100000:2.0:1787118633.390115:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189824 00000100:00100000:2.0:1787118633.390154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787118633.390163:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566189824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.390390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566189824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.390397:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787118633.397235:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.397304:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.397384:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.397421:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.398824:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566189952 00000100:00100000:2.0:1787118633.398836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566189952 00000100:00100000:2.0:1787118633.398892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787118633.398902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566189952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.399139:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566189952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.399147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787118633.400156:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566189952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.408678:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8478:1873929566190080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118633.408798:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.408835:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.408887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190080 00000100:00100000:1.0:1787118633.408894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190080 00000100:00100000:1.0:1787118633.408942:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787118633.408951:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:8478:x1873929566190080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118633.409226:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:8478:x1873929566190080:12345-0@lo:502:llog_process_th.0 Request processed in 275us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118633.409233:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787118633.410046:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8478:1873929566190080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118633.410116:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8478:1873929566190208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118633.410167:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.410201:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.410348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190208 00000100:00100000:3.0:1787118633.410353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190208 00000100:00100000:3.0:1787118633.410393:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787118633.410402:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:8478:x1873929566190208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.410592:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:8478:x1873929566190208:12345-0@lo:502:llog_process_th.0 Request processed in 190us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.410598:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787118633.410793:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8478:1873929566190208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787118633.410812:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787118633.410983:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787118633.411004:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118633.411022:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.411032:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118633.411047:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787118633.411049:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787118633.411052:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787118633.411073:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.411090:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.411100:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118633.411114:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.411141:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.411161:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810480 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.411339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190336 00000100:00100000:2.0:1787118633.411344:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190336 00000100:00100000:2.0:1787118633.411385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787118633.411393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:5838:x1873929566190336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118633.411402:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118633.411414:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382174400/0xaa534e3c784f8581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f857a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.411446:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382174400/0xaa534e3c784f8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f857a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.411463:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382174400/0xaa534e3c784f8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f857a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.411472:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382174400, rc 0) 00000100:00100000:2.0:1787118633.411508:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.411514:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787118633.411550:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118633.411560:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.411568:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.411625:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.411651:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.411666:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.411678:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190464 00000100:00100000:2.0:1787118633.411681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190464 00000100:00100000:2.0:1787118633.411698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787118633.411704:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.411936:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.411943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787118633.411981:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.412848:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.412901:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.413060:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.414941:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190592 00000100:00100000:3.0:1787118633.414954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190592 00000100:00100000:3.0:1787118633.415202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787118633.415214:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.415573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.415581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787118633.418146:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118633.418930:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8479:1873929566190720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118633.419012:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118633.419163:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.419297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190720 00000100:00100000:3.0:1787118633.419304:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190720 00000100:00100000:3.0:1787118633.419350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787118633.419359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:8479:x1873929566190720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.419975:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:8479:x1873929566190720:12345-0@lo:502:llog_process_th.0 Request processed in 615us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.419990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787118633.420124:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8479:1873929566190720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787118633.420153:0:8479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118633.420163:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118633.420165:0:8479:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787118633.420173:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787118633.420198:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8479:1873929566190848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118633.420234:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118633.420266:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.420312:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190848 00000100:00100000:2.0:1787118633.420317:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190848 00000100:00100000:2.0:1787118633.420356:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787118633.420365:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:8479:x1873929566190848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118633.420832:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:8479:x1873929566190848:12345-0@lo:502:llog_process_th.0 Request processed in 467us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.420840:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787118633.420953:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8479:1873929566190848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787118633.420986:0:8479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118633.420991:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118633.420993:0:8479:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787118633.420997:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787118633.421255:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787118633.421274:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787118633.421283:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.421293:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118633.421303:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787118633.421306:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961347c3c800 from 39 10000000:01000000:2.0:1787118633.421309:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787118633.421335:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.421342:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.421352:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.421375:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.421405:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.421555:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566190976 00000100:00100000:0.0:1787118633.421560:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566190976 00000100:00100000:0.0:1787118633.421613:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787118633.421621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566190976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118633.421632:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118633.421644:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340030c00/0xaa534e3c784f858f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8588 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118633.421664:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030c00/0xaa534e3c784f858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8588 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118633.421675:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340030c00/0xaa534e3c784f858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8588 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118633.421683:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030c00, rc 0) 00000100:00100000:0.0:1787118633.421710:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566190976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.421716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787118633.425771:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.425820:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566190976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118633.425883:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.425896:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.426106:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.426170:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.426215:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.426300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191104 00000100:00100000:3.0:1787118633.426306:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191104 00000100:00100000:3.0:1787118633.426350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787118633.426359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566191104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.427005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566191104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 645us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.427132:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.427171:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.427213:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.427238:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118633.427251:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191232 00000100:00100000:0.0:1787118633.427254:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191232 00000100:00100000:3.0:1787118633.427986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787118633.434036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787118633.434061:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566191232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118633.434357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566191232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.434366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787118633.434990:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.435819:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8480:1873929566191360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.435877:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.435914:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.435987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191360 00000100:00100000:2.0:1787118633.435994:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191360 00000100:00100000:2.0:1787118633.436114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787118633.436124:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8480:x1873929566191360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118633.436414:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8480:x1873929566191360:12345-0@lo:502:llog_process_th.0 Request processed in 292us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.436487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787118633.436817:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8480:1873929566191360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.436861:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8480:1873929566191488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.436898:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.436925:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.437097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191488 00000100:00100000:2.0:1787118633.437102:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191488 00000100:00100000:2.0:1787118633.437134:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787118633.437143:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8480:x1873929566191488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118633.438170:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8480:x1873929566191488:12345-0@lo:502:llog_process_th.0 Request processed in 1024us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.438190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787118633.438357:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8480:1873929566191488:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787118633.438386:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787118633.438803:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787118633.438831:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787118633.438840:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.438862:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118633.438873:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787118633.438875:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787118633.438878:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787118633.438905:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.438912:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.438920:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118633.438937:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118633.438989:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.439159:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191616 00000100:00100000:2.0:1787118633.439165:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191616 00000100:00100000:2.0:1787118633.439208:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787118633.439217:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566191616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118633.439228:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118633.439241:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382175200/0xaa534e3c784f859d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8596 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.439263:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382175200/0xaa534e3c784f859d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8596 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.439273:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382175200/0xaa534e3c784f859d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8596 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.439493:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382175200, rc 0) 00000100:00100000:2.0:1787118633.439674:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566191616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 308us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.439682:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787118633.439871:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.439888:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118633.439902:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.439910:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118633.439957:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118633.439995:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118633.440153:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191744 00000100:00100000:0.0:1787118633.440158:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191744 00000100:00100000:0.0:1787118633.440190:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787118633.440198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566191744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118633.440584:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118633.440902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566191744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 703us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.440910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787118633.441043:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.441083:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.441123:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.441181:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787118633.441271:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566191872 00000100:00100000:1.0:1787118633.441276:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566191872 00000100:00100000:1.0:1787118633.441368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787118633.441376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566191872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118633.441548:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566191872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118633.441555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787118633.441621:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566191872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.442693:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8481:1873929566192000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.442874:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.442943:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787118633.442984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192000 00000100:00100000:0.0:1787118633.442990:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192000 00000100:00100000:0.0:1787118633.443124:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787118633.443133:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8481:x1873929566192000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118633.443340:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8481:x1873929566192000:12345-0@lo:502:llog_process_th.0 Request processed in 208us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118633.443348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787118633.443418:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8481:1873929566192000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118633.443455:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118633.443469:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118633.443471:0:8481:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787118633.443478:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787118633.443500:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8481:1873929566192128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118633.443544:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118633.443905:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787118633.443992:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192128 00000100:00100000:2.0:1787118633.443998:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192128 00000100:00100000:2.0:1787118633.444039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787118633.444047:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8481:x1873929566192128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118633.444211:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8481:x1873929566192128:12345-0@lo:502:llog_process_th.0 Request processed in 165us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.444218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787118633.444350:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8481:1873929566192128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118633.444372:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118633.444377:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118633.444379:0:8481:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787118633.444383:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787118633.444684:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787118633.444706:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787118633.444715:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.444754:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118633.444763:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787118633.444766:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff961346264d40 from 1 10000000:01000000:2.0:1787118633.444768:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787118633.444792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.444800:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.444809:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.444824:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566192256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.444853:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.444877:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.444932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192256 00000100:00100000:3.0:1787118633.444938:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192256 00000100:00100000:3.0:1787118633.444957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787118633.444975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566192256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118633.444983:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118633.444993:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f85ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f85a4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.445028:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f85ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f85a4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.445037:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f85ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85a4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118633.445044:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8cc00, rc 0) 00000100:00100000:3.0:1787118633.445078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566192256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118633.445083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787118633.446750:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566192256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118633.446773:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.446797:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118633.446857:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566192384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118633.446896:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.446920:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787118633.446988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192384 00000100:00100000:3.0:1787118633.446993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192384 00000100:00100000:3.0:1787118633.447032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787118633.447040:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566192384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118633.447258:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566192384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (359us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787118633.447265:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787118633.447937:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566192384:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787118633.447981:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787118633.447989:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118633.447998:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118633.738570:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118633.802416:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787118633.802441:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566192512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118633.802509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118633.802638:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192512 00000100:00100000:2.0:1787118633.802654:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192512 00000100:00100000:2.0:1787118633.802715:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787118633.802745:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566192512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118633.802780:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118633.802835:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566192512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118633.802842:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787118633.803131:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375eb8a80 x1873929566192512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118633.803149:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566192512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118634.763613:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118635.785890:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118636.252771:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118636.252814:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118636.252847:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118636.252852:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143616 00000100:00100000:2.0:1787118636.252862:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143616 00000100:00100000:2.0:1787118636.252929:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 166 00000100:00100000:2.0:1787118636.252939:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+8:2371:x1873929544143616:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118636.252975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118636.253000:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118636.253012:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+8:2371:x1873929544143616:12345-192.168.203.10@tcp:400: Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118636.253018:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 166 00000100:00100000:2.0:1787118636.253041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144128 00000100:00100000:2.0:1787118636.253045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144128 00000100:00100000:2.0:1787118636.253059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:2.0:1787118636.253065:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+8:5611:x1873929544144128:12345-192.168.203.10@tcp:101: 00010000:00010000:2.0:1787118636.253075:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787118636.253080:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143872 00000100:00100000:3.0:1787118636.253083:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143872 00010000:00010000:2.0:1787118636.253090:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382174600/0xaa534e3c784f85b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b85b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118636.253113:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144000 00010000:00010000:2.0:1787118636.253113:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382174600/0xaa534e3c784f85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b85b expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118636.253116:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144000 00010000:00010000:2.0:1787118636.253125:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382174600/0xaa534e3c784f85b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b85b expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118636.253133:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00010000:00010000:2.0:1787118636.253134:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382174600, rc 0) 00000100:00100000:3.0:1787118636.253140:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544143872:12345-192.168.203.10@tcp:400: 00000100:00100000:2.0:1787118636.253170:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144128:12345-192.168.203.10@tcp:101: Request processed in 105us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118636.253180:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:2.0:1787118636.253205:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:0.0:1787118636.253209:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544143744 00000100:00100000:0.0:1787118636.253212:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544143744 00000100:00100000:2.0:1787118636.253213:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544144000:12345-192.168.203.10@tcp:400: 00000100:00100000:0.0:1787118636.253243:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:0.0:1787118636.253261:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544143744:12345-192.168.203.10@tcp:400: 00000100:00100000:3.0:1787118636.253757:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544143872:12345-192.168.203.10@tcp:400: Request processed in 615us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118636.253765:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00080000:3.0:1787118636.253786:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118636.253791:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118636.253793:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118636.256788:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544144000:12345-192.168.203.10@tcp:400: Request processed in 3563us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118636.256828:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:3.0:1787118636.258483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118636.258717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144256 00000100:00100000:2.0:1787118636.258744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144256 00000100:00100000:2.0:1787118636.258798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 168 00000100:00100000:2.0:1787118636.258808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144256:12345-192.168.203.10@tcp:501: 00000100:00100000:2.0:1787118636.262140:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144256:12345-192.168.203.10@tcp:501: Request processed in 3322us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118636.262153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 168 00000100:00100000:0.0:1787118636.263045:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544143744:12345-192.168.203.10@tcp:400: Request processed in 9780us (10191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118636.263056:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:3.0:1787118636.281117:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118636.282106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144384 00000100:00100000:0.0:1787118636.282117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144384 00000100:00100000:0.0:1787118636.282193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 169 00000100:00100000:0.0:1787118636.282204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144384:12345-192.168.203.10@tcp:503: 00000100:00100000:0.0:1787118636.282774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144384:12345-192.168.203.10@tcp:503: Request processed in 570us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118636.282783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 169 00000100:00100000:1.0:1787118636.288532:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118636.288639:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144512 00000100:00100000:2.0:1787118636.288648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144512 00000100:00100000:2.0:1787118636.288715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 170 00000100:00100000:2.0:1787118636.288747:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:6097:x1873929544144512:12345-192.168.203.10@tcp:502: 00000100:00100000:2.0:1787118636.289035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+9:6097:x1873929544144512:12345-192.168.203.10@tcp:502: Request processed in 311us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118636.289044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 170 00000100:00100000:2.0:1787118636.293821:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118636.294187:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144640 00000100:00100000:3.0:1787118636.294197:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144640 00000100:00100000:0.0:1787118636.294458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:0.0:1787118636.294470:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+9:6097:x1873929544144640:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787118636.294745:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+9:6097:x1873929544144640:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 277us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118636.294753:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:1.0:1787118636.305418:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118636.306027:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144768 00000100:00100000:0.0:1787118636.306037:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144768 00000100:00100000:0.0:1787118636.306102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00100000:0.0:1787118636.306113:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544144768:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118636.306128:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118636.306145:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340030a00/0xaa534e3c784f85b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b862 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118636.306172:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030a00/0xaa534e3c784f85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b862 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118636.306184:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340030a00/0xaa534e3c784f85b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b862 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118636.306192:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030a00, rc 0) 00000100:00100000:0.0:1787118636.306246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544144768:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 136us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118636.306266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00100000:1.0:1787118636.323141:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118636.323301:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544144896 00000100:00100000:0.0:1787118636.323309:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544144896 00000100:00100000:0.0:1787118636.323926:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 173 00000100:00100000:0.0:1787118636.323950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544144896:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118636.324321:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544144896:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 273us (1078us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787118636.324329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 173 00010000:00010000:2.0:1787118636.809927:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787118637.749506:0:8519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe91987d40 20000000:00000080:3.0:1787118637.749520:0:8519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96136e973800 uarg=0000000000000000 20000000:01000000:3.0:1787118637.749553:0:8519:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787118637.749558:0:8519:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787118637.749563:0:8519:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787118637.752202:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787118637.752404:0:8519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787118637.772335:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787118637.772383:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787118637.777774:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787118637.777812:0:8519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787118637.777831:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777851:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f832e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777858:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777865:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f845b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777874:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777880:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777920:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.777946:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 9 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.777961:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192640:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118637.778074:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.778083:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.778092:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192768:0@lo:104: 00000100:00100000:3.0:1787118637.778132:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118637.778167:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.778174:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.778181:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192896:0@lo:104: 00000100:00100000:3.0:1787118637.778202:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118637.778221:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.778229:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.778237:0:8519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566193024:0@lo:104: 00000100:00100000:3.0:1787118637.778257:0:8519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118637.778338:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787118637.778355:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.778366:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192768 00000100:00100000:1.0:1787118637.778372:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192768 00000100:00100000:1.0:1787118637.778416:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566192896 00000100:00100000:1.0:1787118637.778419:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566192896 00000100:00100000:1.0:1787118637.778429:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193024 00000100:00100000:1.0:1787118637.778431:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193024 00000100:00100000:1.0:1787118637.778443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787118637.778451:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:8519:x1873929566192768:12345-0@lo:104: 00010000:00010000:1.0:1787118637.778472:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778530:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118637.778536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:8519:x1873929566192768:12345-0@lo:104: Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.778543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787118637.778559:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787118637.778565:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:8519:x1873929566192896:12345-0@lo:104: 00010000:00010000:1.0:1787118637.778571:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778604:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787118637.778609:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:8519:x1873929566192896:12345-0@lo:104: Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.778615:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787118637.778638:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787118637.778645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:8519:x1873929566193024:12345-0@lo:104: 00010000:00010000:1.0:1787118637.778651:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778682:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787118637.778687:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:8519:x1873929566193024:12345-0@lo:104: Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.778693:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787118637.778710:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787118637.778715:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778749:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382175a00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118637.778753:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778760:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118637.778766:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118637.778772:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787118637.778797:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778804:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118637.778821:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778828:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382175a00/0xaa534e3c784f845b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8462 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778840:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118637.778842:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778847:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118637.778849:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778864:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118637.778869:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118637.778874:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787118637.778885:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778890:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118637.778905:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778911:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340031000/0xaa534e3c784f8390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8397 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778920:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118637.778923:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778928:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9613414b0000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118637.778943:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778949:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118637.778954:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118637.778965:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787118637.778977:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778982:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787118637.778988:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.778993:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff9613414b0000/0xaa534e3c784f832e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f8335 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779005:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118637.779007:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118637.779008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118637.779015:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118637.779019:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118637.779034:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566193152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118637.779061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.779095:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566193280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118637.779115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.779133:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118637.779138:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566193408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118637.779155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.779181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193152 00000100:00100000:1.0:1787118637.779185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193152 00010000:00010000:1.0:1787118637.779202:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 19 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118637.779234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193280 00000100:00100000:1.0:1787118637.779237:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193280 00010000:00010000:1.0:1787118637.779248:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118637.779256:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193408 00000100:00100000:1.0:1787118637.779258:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193408 00010000:00010000:1.0:1787118637.779267:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118637.779278:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787118637.779283:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3299:x1873929566193152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118637.779292:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118637.779297:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 21 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779305:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 21 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779318:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118637.779343:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+21:3299:x1873929566193152:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.779350:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787118637.779362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787118637.779367:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3300:x1873929566193280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118637.779374:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118637.779379:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779395:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779404:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118637.779429:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3300:x1873929566193280:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.779436:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787118637.779448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787118637.779454:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566193408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118637.779462:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118637.779466:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 19 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779473:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 19 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118637.779481:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118637.779501:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566193408:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.779506:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787118637.779544:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566193152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118637.779567:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566193408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118637.779575:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566193280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787118637.780092:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042600/0xaa534e3c784f8462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f845b expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.780104:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192768:0@lo:104: 00010000:00010000:3.0:1787118637.780115:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030800/0xaa534e3c784f8397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8390 expref: 17 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.780133:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192896:0@lo:104: 00010000:00010000:3.0:1787118637.780147:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031400/0xaa534e3c784f8335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f832e expref: 16 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.780155:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566193024:0@lo:104: 00000100:00100000:1.0:1787118637.784217:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118637.784289:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145024 00000100:00100000:0.0:1787118637.784298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145024 00010000:00010000:0.0:1787118637.784332:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 10 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118637.784369:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:0.0:1787118637.784379:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544145024:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118637.784393:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118637.784399:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 10 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784411:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 10 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784432:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784454:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784469:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784476:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784483:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784489:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784495:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118637.784499:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784506:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784514:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118637.784524:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118637.784570:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+10:2369:x1873929544145024:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 193us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118637.784578:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00010000:00010000:3.0:1787118637.785042:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f851f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b82a expref: 9 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118637.785054:0:8519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1873929566192640:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118637.785080:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.785089:0:8519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.785095:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118637.785101:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f85c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118637.834877:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118637.901495:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566193792:0@lo:400:kworker.0 00000100:00100000:1.0:1787118637.901563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.901616:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118637.901623:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566193920:0@lo:400:kworker.0 00000100:00100000:1.0:1787118637.901649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118637.901702:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193920 00000100:00100000:1.0:1787118637.901709:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193920 00000100:00100000:1.0:1787118637.901783:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787118637.901793:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566193920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118637.901838:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566193920:12345-0@lo:400:kworker.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118637.901845:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787118637.901877:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa66a00 x1873929566193920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118637.901889:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566193920:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905277:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566193664:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118637.905378:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566194176:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118637.905457:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787118637.905464:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566193536:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118637.905522:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566194048:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118637.905585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193792 00000100:00100000:2.0:1787118637.905591:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193792 00000100:00100000:2.0:1787118637.905631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193664 00000100:00100000:2.0:1787118637.905634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193664 00000100:00100000:2.0:1787118637.905653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194048 00000100:00100000:2.0:1787118637.905656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194048 00000100:00100000:2.0:1787118637.905671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787118637.905679:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566193792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905761:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566193792:12345-0@lo:400:kworker.0 Request processed in 83us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118637.905768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787118637.905785:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787118637.905791:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566193664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905817:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566193664:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118637.905824:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787118637.905832:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787118637.905838:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566194048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905861:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566194048:12345-0@lo:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118637.905867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787118637.905883:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194176 00000100:00100000:2.0:1787118637.905886:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194176 00000100:00100000:2.0:1787118637.905910:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787118637.905922:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566194176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.905965:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566194176:12345-0@lo:400:kworker.0 Request processed in 44us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118637.905971:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787118637.905989:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566193536 00000100:00100000:2.0:1787118637.905992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566193536 00000100:00100000:2.0:1787118637.906017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787118637.906023:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3299:x1873929566193536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.906049:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3299:x1873929566193536:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118637.906054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787118637.906103:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566193792:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.906134:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566193536:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.906144:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566194048:0@lo:400:kworker.0 00000100:00100000:2.0:1787118637.906152:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566193664:0@lo:400:kworker.0 00010000:00080000:2.0:1787118637.906162:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566194176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118637.906171:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566194176:0@lo:400:kworker.0 00000100:00080000:3.0:1787118637.906757:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118637.906764:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118637.906766:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118638.079669:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118638.087223:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145152 00000100:00100000:1.0:1787118638.087237:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145152 00000100:00100000:1.0:1787118638.087319:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 175 00000100:00100000:1.0:1787118638.087330:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+9:5611:x1873929544145152:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118638.087348:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118638.087367:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b869 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118638.087395:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118638.087405:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118638.087435:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8000, rc 0) 00000100:00100000:1.0:1787118638.087507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544145152:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 179us (7847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118638.087514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 175 00000100:00100000:0.0:1787118638.090237:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118638.090580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145280 00000100:00100000:1.0:1787118638.090588:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145280 00000100:00100000:1.0:1787118638.090646:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:1.0:1787118638.090655:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544145280:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118638.091492:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544145280:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 833us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118638.091502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:2.0:1787118638.102949:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118638.103035:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145408 00000100:00100000:1.0:1787118638.103045:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145408 00000100:00100000:1.0:1787118638.103102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00100000:1.0:1787118638.103114:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544145408:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118638.103335:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:5611:x1873929544145408:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 224us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118638.103343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00100000:0.0:1787118638.109557:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118638.109646:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145536 00000100:00100000:3.0:1787118638.109654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145536 00000100:00100000:3.0:1787118638.109708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 178 00000100:00100000:3.0:1787118638.109717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:6136:x1873929544145536:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118638.109992:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:6136:x1873929544145536:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 274us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118638.110000:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 178 00000100:00100000:0.0:1787118638.117985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118638.122357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145664 00000100:00100000:2.0:1787118638.122373:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145664 00000100:00100000:2.0:1787118638.122448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 179 00000100:00100000:2.0:1787118638.122463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:6136:x1873929544145664:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787118638.122713:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:6136:x1873929544145664:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 251us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118638.122747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 179 00000100:00100000:0.0:1787118638.411144:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787118638.411167:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566194304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118638.411239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118638.411406:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194304 00000100:00100000:2.0:1787118638.411413:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194304 00000100:00100000:2.0:1787118638.411470:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118638.411480:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566194304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787118638.411514:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118638.411575:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566194304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118638.411582:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787118638.411657:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351522300 x1873929566194304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118638.411686:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566194304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787118638.860958:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118638.921983:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118638.922007:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566194432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118638.922074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118638.922182:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194432 00000100:00100000:2.0:1787118638.922190:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194432 00000100:00100000:2.0:1787118638.922245:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118638.922255:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566194432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118638.922289:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118638.922341:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566194432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118638.922347:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787118638.922426:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375eb9880 x1873929566194432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118638.922444:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566194432:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1787118639.562810:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787118639.562817:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137a707800 from 4 10000000:01000000:1.0:1787118639.562822:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787118639.562873:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.562884:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.562903:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118639.562936:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118639.563001:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118639.563069:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118639.563102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194560 00000100:00100000:1.0:1787118639.563109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194560 00000100:00100000:1.0:1787118639.563153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787118639.563162:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566194560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118639.563174:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118639.563187:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f85ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.563208:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.563219:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.563228:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8c00, rc 0) 00000100:00100000:1.0:1787118639.563266:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566194560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118639.563273:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787118639.563600:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118639.563615:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.563629:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118639.563679:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118639.563704:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118639.563793:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.564592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194688 00000100:00100000:2.0:1787118639.564599:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194688 00000100:00100000:2.0:1787118639.564680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787118639.564691:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566194688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.565905:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566194688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1212us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.565935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787118639.566702:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.566788:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.566844:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.566880:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.566896:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194816 00000100:00100000:2.0:1787118639.566902:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194816 00000100:00100000:2.0:1787118639.566950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787118639.566960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566194816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.567811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566194816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 850us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.567820:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787118639.567957:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566194816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118639.568866:0:8584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8584:1873929566194944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118639.568916:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118639.568986:0:8584:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137a84a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.578130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566194944 00000100:00100000:2.0:1787118639.578144:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566194944 00000100:00100000:2.0:1787118639.578213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787118639.578224:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8584:x1873929566194944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118639.578470:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8584:x1873929566194944:12345-0@lo:502:llog_process_th.0 Request processed in 248us (9552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.578478:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787118639.579100:0:8584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8584:1873929566194944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118639.579136:0:8584:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118639.579146:0:8584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118639.579148:0:8584:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787118639.579155:0:8584:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137a707800 00000020:00000080:3.0:1787118639.579157:0:8584:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787118639.579598:0:8584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8584:1873929566195072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118639.579711:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118639.579756:0:8584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.580331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195072 00000100:00100000:2.0:1787118639.580339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195072 00000100:00100000:2.0:1787118639.580393:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787118639.580403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8584:x1873929566195072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118639.580848:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:8584:x1873929566195072:12345-0@lo:502:llog_process_th.0 Request processed in 446us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.580865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787118639.583943:0:8584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8584:1873929566195072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118639.583999:0:8584:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118639.584008:0:8584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118639.584010:0:8584:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787118639.584016:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787118639.592440:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787118639.592474:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787118639.592495:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.592508:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118639.592519:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787118639.592522:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375697800 from 4 10000000:01000000:2.0:1787118639.592525:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787118639.592562:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.592570:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.592580:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118639.593058:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.593120:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.593169:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.593208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195200 00000100:00100000:2.0:1787118639.593215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195200 00000100:00100000:2.0:1787118639.593262:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787118639.593270:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566195200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118639.593282:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118639.593303:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f85dc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.593327:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.593338:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.593346:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986600, rc 0) 00000100:00100000:2.0:1787118639.593389:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.593395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787118639.593441:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118639.593456:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.593464:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118639.595125:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.595203:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.595260:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.597670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195328 00000100:00100000:2.0:1787118639.597683:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195328 00000100:00100000:2.0:1787118639.597748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787118639.597759:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.598626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 866us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.598644:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787118639.598707:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.598783:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.599298:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.599336:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.599354:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195456 00000100:00100000:2.0:1787118639.599359:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195456 00000100:00100000:2.0:1787118639.599992:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787118639.600004:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.600463:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 461us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.600471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787118639.600599:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118639.603601:0:8588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8588:1873929566195584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118639.603683:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118639.603757:0:8588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.604481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195584 00000100:00100000:2.0:1787118639.604558:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195584 00000100:00100000:2.0:1787118639.604607:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787118639.604616:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8588:x1873929566195584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118639.605324:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8588:x1873929566195584:12345-0@lo:502:llog_process_th.0 Request processed in 708us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.605333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787118639.607630:0:8588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8588:1873929566195584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118639.607674:0:8588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118639.607683:0:8588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118639.607686:0:8588:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787118639.607694:0:8588:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961375697800 00000020:00000080:3.0:1787118639.607697:0:8588:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787118639.609450:0:8588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8588:1873929566195712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118639.609534:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118639.609584:0:8588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118639.611206:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195712 00000100:00100000:3.0:1787118639.611221:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195712 00000100:00100000:3.0:1787118639.618896:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787118639.618914:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8588:x1873929566195712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118639.619478:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:8588:x1873929566195712:12345-0@lo:502:llog_process_th.0 Request processed in 568us (9942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118639.619487:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787118639.619938:0:8588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375be8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8588:1873929566195712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118639.619972:0:8588:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118639.619980:0:8588:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118639.619983:0:8588:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787118639.619988:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787118639.622052:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787118639.622084:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787118639.622094:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.622118:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118639.622128:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787118639.622131:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961347c3c800 from 4 10000000:01000000:2.0:1787118639.622133:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787118639.622167:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.622174:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.622195:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118639.622220:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.622279:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.622320:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.622339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195840 00000100:00100000:2.0:1787118639.622346:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195840 00000100:00100000:2.0:1787118639.622968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787118639.622980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566195840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118639.622995:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118639.623007:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f85ea expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.623028:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.623050:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.623058:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986400, rc 0) 00000100:00100000:2.0:1787118639.623097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566195840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.623104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787118639.623158:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118639.623173:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118639.623182:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118639.623244:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.623269:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.623294:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.623307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566195968 00000100:00100000:2.0:1787118639.623310:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566195968 00000100:00100000:2.0:1787118639.623333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787118639.623340:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566195968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.624833:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566195968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1487us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.624844:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787118639.633264:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566195968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.633334:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566196096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.633457:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118639.633552:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f810300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118639.633569:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196096 00000100:00100000:2.0:1787118639.633574:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196096 00000100:00100000:2.0:1787118639.633612:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787118639.633620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566196096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118639.633815:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566196096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118639.633822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787118639.633861:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566196096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118639.641797:0:8591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8591:1873929566196224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118639.641969:0:8591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118639.642011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196224 00000100:00100000:0.0:1787118639.642018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196224 00000100:00100000:0.0:1787118639.642059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787118639.642068:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:8591:x1873929566196224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118639.643046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:8591:x1873929566196224:12345-0@lo:502:llog_process_th.0 Request processed in 975us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118639.643057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787118639.643153:0:8591:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118639.643176:0:8591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8591:1873929566196224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787118639.643277:0:8591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118639.643286:0:8591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118639.643288:0:8591:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787118639.643294:0:8591:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961347c3c800 00000020:00000080:0.0:1787118639.643296:0:8591:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787118639.643371:0:8591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8591:1873929566196352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118639.643880:0:8591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118639.643910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196352 00000100:00100000:0.0:1787118639.643916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196352 00000100:00100000:0.0:1787118639.643968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787118639.643976:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:8591:x1873929566196352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118639.644124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:8591:x1873929566196352:12345-0@lo:502:llog_process_th.0 Request processed in 148us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118639.644132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787118639.644167:0:8591:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118639.644182:0:8591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:8591:1873929566196352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787118639.644217:0:8591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118639.644222:0:8591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118639.644224:0:8591:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787118639.644227:0:8591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787118639.644346:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787118639.644369:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787118639.644380:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118639.644391:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118639.881895:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118640.910488:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118641.370801:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118641.370845:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118641.370898:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118641.370937:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118641.370967:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146048 00000100:00100000:1.0:1787118641.370972:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146176 00000100:00100000:2.0:1787118641.370975:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146048 00000100:00100000:1.0:1787118641.370975:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146176 00000100:00100000:1.0:1787118641.371030:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:0.0:1787118641.371033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145792 00000100:00100000:0.0:1787118641.371036:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145792 00000100:00100000:1.0:1787118641.371039:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544146176:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118641.371062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 195 00000100:00100000:0.0:1787118641.371067:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544145792:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118641.371104:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544146176:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118641.371127:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:3.0:1787118641.371162:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544145920 00000100:00100000:3.0:1787118641.371166:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544145920 00000100:00100000:2.0:1787118641.371762:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:2.0:1787118641.371786:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544146048:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118641.375481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:3.0:1787118641.375497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544145920:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118641.375625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544145792:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 4555us (4830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118641.375635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 195 00000100:00080000:0.0:1787118641.375705:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787118641.375711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118641.375713:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118641.381540:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544146048:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 9757us (10681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118641.381567:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:3.0:1787118641.383297:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544145920:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 7796us (12396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118641.383323:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00010000:00010000:2.0:1787118641.935013:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118642.955968:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118643.022407:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118643.022494:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118643.022524:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566196608:0@lo:400:kworker.0 00000100:00100000:0.0:1787118643.022628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118643.022703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196608 00000100:00100000:0.0:1787118643.022710:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196608 00000100:00100000:0.0:1787118643.024302:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787118643.024317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566196608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118643.024408:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566196608:12345-0@lo:400:kworker.0 Request processed in 96us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118643.024415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787118643.024470:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566196608:0@lo:400:kworker.0 00000100:00100000:3.0:1787118643.029188:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566196480:0@lo:400:kworker.0 00000100:00100000:3.0:1787118643.029306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118643.029641:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118643.029658:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566196736:0@lo:400:kworker.0 00000100:00100000:0.0:1787118643.029748:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196480 00000100:00100000:2.0:1787118643.029749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118643.029763:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196480 00000100:00100000:2.0:1787118643.029816:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196736 00000100:00100000:2.0:1787118643.029825:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196736 00000100:00100000:0.0:1787118643.029840:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787118643.029852:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566196480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.029912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787118643.029932:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566196736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118643.029959:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566196480:12345-0@lo:400:kworker.0 Request processed in 108us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118643.029968:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787118643.030008:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566196736:12345-0@lo:400:kworker.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118643.030018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787118643.030049:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118643.030089:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566196736:0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.030161:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566196992:0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.030188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118643.030223:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196992 00000100:00100000:2.0:1787118643.030227:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196992 00000100:00100000:2.0:1787118643.030256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787118643.030263:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566196992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.030298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566196992:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118643.030616:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787118643.030637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118643.030661:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566196992:0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.030696:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118643.030702:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566197120:0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.030762:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118643.030886:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118643.030906:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566196864:0@lo:400:kworker.0 00000100:00100000:3.0:1787118643.030965:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566196480:0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.031298:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197120 00000100:00100000:2.0:1787118643.031305:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197120 00000100:00100000:2.0:1787118643.031453:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787118643.031463:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566197120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.031509:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566197120:12345-0@lo:400:kworker.0 Request processed in 48us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118643.031515:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787118643.031533:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787118643.031556:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375ebb100 x1873929566197120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118643.031568:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566197120:0@lo:400:kworker.0 00000100:00100000:0.0:1787118643.031863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118643.032052:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566196864 00000100:00100000:2.0:1787118643.032060:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566196864 00000100:00100000:2.0:1787118643.032129:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787118643.032151:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118643.032216:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566196864:12345-0@lo:400:kworker.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118643.032223:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787118643.032264:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375ebb480 x1873929566196864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118643.032277:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566196864:0@lo:400:kworker.0 00000100:00080000:0.0:1787118643.032332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118643.533290:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566197248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118643.533383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118643.533557:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197248 00000100:00100000:1.0:1787118643.533567:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197248 00000100:00100000:1.0:1787118643.533627:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787118643.533637:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566197248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118643.533687:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118643.533758:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566197248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118643.533767:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787118643.533820:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8a80 x1873929566197248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118643.533844:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566197248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118643.984006:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118644.048952:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566197376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118644.049067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118644.050089:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197376 00000100:00100000:1.0:1787118644.050104:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197376 00000100:00100000:1.0:1787118644.050188:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787118644.050201:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566197376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118644.050252:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118644.050345:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566197376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118644.050353:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787118644.050610:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8a80 x1873929566197376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118644.050636:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566197376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787118645.002283:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118646.028388:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787118646.180634:0:8818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787118646.506558:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118646.506608:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118646.506684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118646.506834:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146560 00000100:00100000:3.0:1787118646.506844:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146560 00000100:00100000:3.0:1787118646.506924:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:3.0:1787118646.506933:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2367:x1873929544146560:12345-192.168.203.10@tcp:9:kworker.0 00000020:00000080:3.0:1787118646.506969:0:6703:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f852d 00000100:00080000:3.0:1787118646.506979:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96137f872800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787118646.507016:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787118646.507400:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+2:2367:x1873929544146560:12345-192.168.203.10@tcp:9:kworker.0 Request processed in 467us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118646.507408:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00010000:00010000:3.0:1787118646.507433:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118646.507828:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146304 00000100:00100000:0.0:1787118646.507834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146304 00000100:00100000:0.0:1787118646.507868:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 197 00000100:00100000:0.0:1787118646.507884:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544146304:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118646.507913:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544146304:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 31us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118646.507919:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 197 00000100:00100000:3.0:1787118646.508128:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118646.508285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146432 00000100:00100000:2.0:1787118646.508290:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146432 00000100:00100000:2.0:1787118646.508324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:2.0:1787118646.508346:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544146432:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118646.508377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544146432:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 47us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118646.508383:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00080000:1.0:1787118646.509053:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787118646.509067:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118646.509106:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146688 00000100:00100000:2.0:1787118646.509112:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146688 00000100:00100000:2.0:1787118646.509156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118646.509166:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2367:x1873929544146688:12345-192.168.203.10@tcp:9:kworker.0 00000020:00000080:2.0:1787118646.509190:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8534 00000100:00080000:2.0:1787118646.509198:0:6704:0:(import.c:65:import_set_state_nolock()) ffff96137f873000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787118646.509228:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787118646.509504:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+2:2367:x1873929544146688:12345-192.168.203.10@tcp:9:kworker.0 Request processed in 340us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118646.509511:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00010000:00010000:0.0:1787118646.509604:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787118646.509979:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787118646.697865:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:3.0:1787118646.697885:0:6728:0:(genops.c:906:class_export_put()) final put ffff96137f871000/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:0.0:1787118646.698272:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f871000/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-OST0000 00000020:00000080:2.0:1787118646.698421:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f872800 for lustre-OST0000 00010000:00010000:0.0:1787118647.049916:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118648.073945:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118648.137973:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566197760:0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.138037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118648.138076:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566197632:0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.138110:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118648.138119:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566197888:0@lo:400:kworker.0 00000100:00100000:3.0:1787118648.138127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118648.138185:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566197504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118648.138238:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566198144:0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.140119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118648.140201:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197760 00000100:00100000:0.0:1787118648.140209:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197760 00000100:00100000:0.0:1787118648.140256:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197632 00000100:00100000:0.0:1787118648.140259:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197632 00000100:00100000:0.0:1787118648.142854:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787118648.142889:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.142985:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566197760:12345-0@lo:400:kworker.0 Request processed in 109us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118648.142992:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787118648.143021:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787118648.143028:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566197632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.143056:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566197632:12345-0@lo:400:kworker.0 Request processed in 30us (4934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118648.143062:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787118648.143082:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197888 00000100:00100000:0.0:1787118648.143090:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197888 00000100:00100000:0.0:1787118648.143140:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787118648.143146:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566197888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.143178:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566197888:12345-0@lo:400:kworker.0 Request processed in 32us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118648.143192:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787118648.143210:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118648.143214:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118648.143250:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351521f80 x1873929566197888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118648.143263:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566197888:0@lo:400:kworker.0 00000100:00100000:0.0:1787118648.143289:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566197760:0@lo:400:kworker.0 00000100:00100000:2.0:1787118648.151216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118648.151297:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566198016:0@lo:400:kworker.0 00000100:00100000:2.0:1787118648.151337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118648.151388:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198016 00000100:00100000:2.0:1787118648.151394:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198016 00000100:00100000:2.0:1787118648.151452:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787118648.151461:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566198016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118648.151520:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566198016:12345-0@lo:400:kworker.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118648.151528:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787118648.151564:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118648.151594:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566198016:0@lo:400:kworker.0 00000100:00100000:1.0:1787118648.151783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566197504 00000100:00100000:1.0:1787118648.151788:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566197504 00000100:00100000:1.0:1787118648.151821:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787118648.151828:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566197504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118648.151881:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566197504:12345-0@lo:400:kworker.0 Request processed in 53us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118648.151888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787118648.151935:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566197504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118648.154491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118648.154565:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566197632:0@lo:400:kworker.0 00000100:00100000:2.0:1787118648.154848:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198144 00000100:00100000:2.0:1787118648.154855:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198144 00000100:00100000:2.0:1787118648.155158:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118648.155179:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118648.155424:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566198144:12345-0@lo:400:kworker.0 Request processed in 248us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118648.155432:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787118648.155513:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351523480 x1873929566198144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118648.155527:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566198144:0@lo:400:kworker.0 00000100:00080000:3.0:1787118648.156555:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118648.649885:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566198272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118648.650161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118648.650303:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198272 00000100:00100000:3.0:1787118648.650311:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198272 00000100:00100000:3.0:1787118648.650404:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787118648.650425:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566198272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118648.650462:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118648.650515:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566198272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118648.650522:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787118648.650582:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476caa00 x1873929566198272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118648.650600:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566198272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118649.101757:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118649.174198:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118649.174267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118649.174343:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198400 00000100:00100000:0.0:1787118649.174350:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198400 00000100:00100000:0.0:1787118649.174405:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787118649.174414:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566198400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118649.174446:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118649.174489:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566198400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118649.174496:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787118649.174592:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566198400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118649.174610:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566198400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118650.128175:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787118650.780542:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:1.0:1787118650.780562:0:7647:0:(genops.c:906:class_export_put()) final put ffff96137f873800/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:2.0:1787118650.780714:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f873800/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-OST0001 00000020:00000080:2.0:1787118650.780788:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f873000 for lustre-OST0001 00010000:00010000:0.0:1787118651.153985:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787118651.459313:0:9067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing yml_node 00000100:00100000:3.0:1787118651.608299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118651.608402:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118651.608603:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146944 00000100:00100000:2.0:1787118651.608612:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146944 00000100:00080000:3.0:1787118651.608680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118651.608682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:2.0:1787118651.608693:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544146944:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118651.608791:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544146944:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 100us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118651.608799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:1.0:1787118651.610954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544146816 00000100:00100000:1.0:1787118651.610966:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544146816 00000100:00100000:1.0:1787118651.611048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 199 00000100:00100000:1.0:1787118651.611060:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544146816:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118651.611137:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544146816:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 78us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118651.611145:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 199 00010000:00010000:2.0:1787118652.170120:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118653.194201:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118653.258782:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566198528:0@lo:400:kworker.0 00000100:00100000:1.0:1787118653.258870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118653.258972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198528 00000100:00100000:2.0:1787118653.258980:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198528 00000100:00100000:2.0:1787118653.259030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787118653.259040:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566198528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.263237:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566198656:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.263305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118653.263397:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198656 00000100:00100000:3.0:1787118653.263404:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198656 00000100:00100000:3.0:1787118653.263447:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787118653.263455:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566198656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.263514:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566198656:12345-0@lo:400:kworker.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118653.263521:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787118653.263560:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566198656:0@lo:400:kworker.0 00000100:00100000:2.0:1787118653.270903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566198528:12345-0@lo:400:kworker.0 Request processed in 11855us (12022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118653.270918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787118653.278055:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566199168:0@lo:400:kworker.0 00000100:00100000:0.0:1787118653.278135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118653.278189:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118653.278196:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566199040:0@lo:400:kworker.0 00000100:00100000:0.0:1787118653.278219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118653.278251:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199168 00000100:00100000:0.0:1787118653.278258:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199168 00000100:00100000:0.0:1787118653.278314:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787118653.278323:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566199168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278490:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566198912:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118653.278550:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118653.278555:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566198784:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118653.278594:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199040 00000100:00100000:3.0:1787118653.278597:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199040 00000100:00100000:3.0:1787118653.278622:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198784 00000100:00100000:3.0:1787118653.278625:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198784 00000100:00100000:3.0:1787118653.278643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787118653.278649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566199040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278688:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566199040:12345-0@lo:400:kworker.0 Request processed in 39us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118653.278696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787118653.278710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787118653.278715:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566198784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278759:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566198784:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118653.278764:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787118653.278804:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566198784:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278867:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566198912 00000100:00100000:3.0:1787118653.278870:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566198912 00000100:00100000:3.0:1787118653.278894:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787118653.278900:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566198912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.278935:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566198912:12345-0@lo:400:kworker.0 Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118653.278942:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787118653.278962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118653.278966:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118653.278968:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787118653.278991:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351523480 x1873929566198912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118653.279002:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566198912:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.279027:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566199040:0@lo:400:kworker.0 00000100:00100000:0.0:1787118653.279336:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566199168:12345-0@lo:400:kworker.0 Request processed in 1013us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118653.279352:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787118653.280213:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351521c00 x1873929566199168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118653.280227:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566199168:0@lo:400:kworker.0 00000100:00100000:1.0:1787118653.280461:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566198528:0@lo:400:kworker.0 00000100:00100000:3.0:1787118653.770358:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118653.770382:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566199296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118653.770451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118653.770867:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199296 00000100:00100000:0.0:1787118653.770876:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199296 00000100:00100000:0.0:1787118653.770929:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787118653.770939:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566199296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118653.770977:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118653.771035:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566199296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118653.771042:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787118653.771164:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566199296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118653.771181:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566199296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118654.223453:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118654.281943:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118654.281965:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566199424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118654.282032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118654.283605:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199424 00000100:00100000:0.0:1787118654.283622:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199424 00000100:00100000:0.0:1787118654.283686:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787118654.283697:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566199424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118654.283764:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118654.283845:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566199424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118654.283858:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787118654.287602:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566199424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118654.287635:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566199424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118655.251081:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118656.265897:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118656.748282:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118656.748356:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118656.748436:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147072 00000100:00100000:0.0:1787118656.748449:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147072 00000100:00100000:0.0:1787118656.748523:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 201 00000100:00100000:0.0:1787118656.748535:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544147072:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118656.748624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544147072:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118656.748632:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 201 00000100:00100000:2.0:1787118656.749198:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147200 00000100:00100000:2.0:1787118656.749206:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147200 00000100:00100000:2.0:1787118656.749463:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:2.0:1787118656.749475:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544147200:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118656.749528:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544147200:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 57us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118656.749535:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00080000:0.0:1787118656.750194:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787118657.073889:0:9261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.3 00010000:00010000:2.0:1787118657.291228:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118658.313945:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118658.382591:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787118658.382612:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566199808:0@lo:400:kworker.0 00000100:00100000:0.0:1787118658.382675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118658.382769:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199808 00000100:00100000:0.0:1787118658.382776:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199808 00000100:00100000:0.0:1787118658.382845:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787118658.382855:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118658.382905:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566199808:12345-0@lo:400:kworker.0 Request processed in 51us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118658.382911:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787118658.382931:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118658.382959:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566199808:0@lo:400:kworker.0 00000100:00100000:0.0:1787118658.382993:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566199936:0@lo:400:kworker.0 00000100:00100000:0.0:1787118658.383018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118658.383051:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199936 00000100:00100000:0.0:1787118658.383054:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199936 00000100:00100000:0.0:1787118658.383101:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787118658.383107:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118658.383143:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566199936:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118658.383150:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787118658.383166:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118658.383182:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351520a80 x1873929566199936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118658.383192:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566199936:0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383293:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566199680:0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118658.383348:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566200192:0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118658.383389:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787118658.383395:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566199552:0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118658.383455:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566200064:0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118658.383498:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200192 00000100:00100000:3.0:1787118658.383501:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200192 00000100:00100000:3.0:1787118658.383530:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787118658.383536:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566200192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118658.383570:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566200192:12345-0@lo:400:kworker.0 Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118658.383576:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787118658.383597:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351521c00 x1873929566200192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118658.383606:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566200192:0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.383766:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199552 00000100:00100000:2.0:1787118658.383770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199552 00000100:00100000:2.0:1787118658.383812:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787118658.383820:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566199552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.383859:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566199552:12345-0@lo:400:kworker.0 Request processed in 40us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118658.383865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787118658.383893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566199680 00000100:00100000:2.0:1787118658.383903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566199680 00000100:00100000:2.0:1787118658.383926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200064 00000100:00100000:2.0:1787118658.383929:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200064 00000100:00100000:2.0:1787118658.383949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787118658.383956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566199680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.383984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566199680:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118658.383990:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787118658.384002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787118658.384009:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.384033:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566200064:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118658.384038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787118658.384067:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566199552:0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.384076:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566200064:0@lo:400:kworker.0 00000100:00100000:2.0:1787118658.384084:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566199680:0@lo:400:kworker.0 00000100:00080000:0.0:1787118658.384245:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787118658.384250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118658.890470:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566200320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118658.890538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118658.890873:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200320 00000100:00100000:1.0:1787118658.890881:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200320 00000100:00100000:1.0:1787118658.890935:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787118658.890945:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566200320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118658.890980:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118658.891034:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566200320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118658.891041:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787118658.891202:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566200320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118658.891220:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566200320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118659.337966:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118659.402030:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566200448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118659.402097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118659.402253:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200448 00000100:00100000:3.0:1787118659.402261:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200448 00000100:00100000:3.0:1787118659.402314:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787118659.402322:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566200448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118659.402357:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118659.402473:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566200448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118659.402481:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787118659.402534:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613476c8000 x1873929566200448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118659.402565:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566200448:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787118659.850629:0:9358:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.3 00010000:00010000:0.0:1787118660.361905:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118661.389200:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118661.866029:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118661.866083:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118661.866223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147456 00000100:00100000:0.0:1787118661.866242:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147456 00000100:00100000:0.0:1787118661.866320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:0.0:1787118661.866330:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544147456:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118661.866397:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544147456:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118661.866405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00080000:1.0:1787118661.866572:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118661.867464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147328 00000100:00100000:3.0:1787118661.867482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147328 00000100:00100000:3.0:1787118661.867531:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 203 00000100:00100000:3.0:1787118661.867540:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544147328:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118661.867598:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544147328:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 59us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118661.867606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 203 00010000:00010000:0.0:1787118662.416415:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787118662.750988:0:9455:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.3 00010000:00010000:0.0:1787118663.435067:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118663.498357:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566200704:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.498445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118663.498511:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566201216:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.498535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118663.498568:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787118663.498576:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566200576:0@lo:400:kworker.0 00000100:00100000:1.0:1787118663.498597:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566200960:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.498608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118663.498636:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566201088:0@lo:400:kworker.0 00000100:00100000:1.0:1787118663.498641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118663.498670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118663.498674:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118663.498682:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566200832:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.498707:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200704 00000100:00100000:2.0:1787118663.498715:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200704 00000100:00100000:1.0:1787118663.498745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118663.498803:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201088 00000100:00100000:2.0:1787118663.498807:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201088 00000100:00100000:2.0:1787118663.498830:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200832 00000100:00100000:2.0:1787118663.498833:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200832 00000100:00100000:2.0:1787118663.498850:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787118663.498858:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566200704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118663.499196:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201216 00000100:00100000:0.0:1787118663.499200:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201216 00000100:00100000:0.0:1787118663.499226:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200960 00000100:00100000:0.0:1787118663.499229:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200960 00000100:00100000:0.0:1787118663.499247:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787118663.499276:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566201216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118663.501525:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787118663.501543:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566200960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118663.501612:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566200960:12345-0@lo:400:kworker.0 Request processed in 76us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118663.501621:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787118663.501626:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566200704:12345-0@lo:400:kworker.0 Request processed in 2765us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118663.501636:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787118663.501659:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787118663.501678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787118663.501685:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566201088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118663.501691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566200832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.501748:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566201088:12345-0@lo:400:kworker.0 Request processed in 70us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118663.501767:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787118663.501787:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118663.501948:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787118663.501951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118663.502231:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566201088:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.502260:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566200704:0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.502371:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566200576 00000100:00100000:2.0:1787118663.502377:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566200576 00000100:00100000:2.0:1787118663.502413:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787118663.502422:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566200576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118663.502462:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566200576:12345-0@lo:400:kworker.0 Request processed in 42us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118663.502539:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787118663.502584:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566200576:0@lo:400:kworker.0 00000100:00100000:0.0:1787118663.503201:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566201216:12345-0@lo:400:kworker.0 Request processed in 3938us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118663.503210:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787118663.503264:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f725c00 x1873929566201216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118663.503275:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566201216:0@lo:400:kworker.0 00000100:00100000:1.0:1787118663.503350:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566200832:0@lo:400:kworker.0 00010000:00080000:1.0:1787118663.503364:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e5b1880 x1873929566200960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118663.503374:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566200960:0@lo:400:kworker.0 00000100:00100000:3.0:1787118663.503896:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566200832:12345-0@lo:400:kworker.0 Request processed in 71us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118663.503907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787118664.011079:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118664.011102:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566201344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118664.011245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118664.011789:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201344 00000100:00100000:1.0:1787118664.011799:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201344 00000100:00100000:1.0:1787118664.011899:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787118664.011909:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566201344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118664.011942:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118664.012010:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566201344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118664.012017:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787118664.012087:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa64a80 x1873929566201344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118664.012105:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566201344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118664.461344:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118664.523007:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118664.523040:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566201472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118664.523144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118664.523259:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201472 00000100:00100000:1.0:1787118664.523269:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201472 00000100:00100000:1.0:1787118664.523344:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118664.523355:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566201472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118664.523403:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118664.523463:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566201472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118664.523471:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787118664.523519:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa65180 x1873929566201472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118664.523553:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566201472:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787118664.692461:0:9504:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 19 01:51:02 EDT 2026 00010000:00010000:2.0:1787118665.482478:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118666.506184:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118666.977600:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118666.977634:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118666.977799:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147712 00000100:00100000:3.0:1787118666.977809:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147712 00000100:00100000:3.0:1787118666.977876:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:3.0:1787118666.977887:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544147712:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118666.977959:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544147712:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118666.977966:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00080000:1.0:1787118666.978014:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118666.980385:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147584 00000100:00100000:2.0:1787118666.980397:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147584 00000100:00100000:2.0:1787118666.980515:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 205 00000100:00100000:2.0:1787118666.980527:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544147584:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118666.980589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544147584:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 66us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118666.980595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 205 00010000:00010000:0.0:1787118667.530016:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118668.554001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118668.618283:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566201728:0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.618291:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566201984:0@lo:400:kworker.0 00000100:00100000:1.0:1787118668.618371:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566201856:0@lo:400:kworker.0 00000100:00100000:0.0:1787118668.618424:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566201600:0@lo:400:kworker.0 00000100:00100000:3.0:1787118668.627504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118668.627585:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566202240:0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.627601:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201728 00000100:00100000:2.0:1787118668.627608:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201728 00000100:00100000:3.0:1787118668.627619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118668.627661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787118668.627671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118668.627676:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202240 00000100:00100000:3.0:1787118668.627678:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202240 00000100:00100000:3.0:1787118668.627716:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787118668.627749:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566202240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.627750:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566201728:12345-0@lo:400:kworker.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118668.627757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787118668.627781:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566202240:12345-0@lo:400:kworker.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118668.627787:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787118668.627787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118668.627797:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201984 00000100:00100000:3.0:1787118668.627800:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201984 00000100:00100000:3.0:1787118668.627821:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787118668.627827:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566201984:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787118668.627833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118668.627837:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118668.627954:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566201728:0@lo:400:kworker.0 00010000:00080000:2.0:1787118668.627970:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f724380 x1873929566202240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118668.627981:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566202240:0@lo:400:kworker.0 00000100:00100000:1.0:1787118668.628815:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118668.629201:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201856 00000100:00100000:2.0:1787118668.629208:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201856 00000100:00100000:2.0:1787118668.629786:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787118668.629801:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566201856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.629886:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566201856:12345-0@lo:400:kworker.0 Request processed in 92us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118668.629894:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787118668.629974:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118668.630009:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566201856:0@lo:400:kworker.0 00000100:00100000:0.0:1787118668.633066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118668.633126:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566202112:0@lo:400:kworker.0 00000100:00100000:0.0:1787118668.633160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118668.633510:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566201984:12345-0@lo:400:kworker.0 Request processed in 5679us (5718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118668.633522:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787118668.633620:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f724700 x1873929566201984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118668.633634:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566201984:0@lo:400:kworker.0 00000100:00100000:1.0:1787118668.635020:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202112 00000100:00100000:1.0:1787118668.635032:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202112 00000100:00100000:1.0:1787118668.635121:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787118668.635130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566202112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118668.635213:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566202112:12345-0@lo:400:kworker.0 Request processed in 83us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118668.635219:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787118668.635262:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566202112:0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.635466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566201600 00000100:00100000:2.0:1787118668.635480:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566201600 00000100:00100000:2.0:1787118668.635518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787118668.635526:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566201600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118668.635565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566201600:12345-0@lo:400:kworker.0 Request processed in 41us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118668.635571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787118668.635620:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566201600:0@lo:400:kworker.0 00000100:00080000:0.0:1787118668.635783:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118669.131643:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787118669.131667:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566202368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118669.131762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118669.134071:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202368 00000100:00100000:1.0:1787118669.134085:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202368 00000100:00100000:1.0:1787118669.134159:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787118669.134169:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566202368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118669.134217:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118669.134307:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566202368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118669.134314:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787118669.134684:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa66a00 x1873929566202368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118669.134706:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566202368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787118669.579275:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118669.644624:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118669.644647:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96134649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118669.644747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118669.644820:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202496 00000100:00100000:3.0:1787118669.644828:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202496 00000100:00100000:3.0:1787118669.644874:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787118669.644883:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566202496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118669.644916:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118669.644958:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566202496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118669.644972:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787118669.645016:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96134649f480 x1873929566202496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118669.645033:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96134649f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566202496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787118670.604892:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118671.634840:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118672.093848:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118672.093890:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118672.093996:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147968 00000100:00100000:2.0:1787118672.094008:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147968 00000100:00100000:2.0:1787118672.094075:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:2.0:1787118672.094091:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544147968:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118672.094180:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544147968:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118672.094188:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00080000:2.0:1787118672.094211:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118672.094585:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544147840 00000100:00100000:3.0:1787118672.094591:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544147840 00000100:00100000:3.0:1787118672.094619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 207 00000100:00100000:3.0:1787118672.094627:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2370:x1873929544147840:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118672.094662:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+10:2370:x1873929544147840:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 36us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118672.094669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 207 00010000:00010000:2.0:1787118672.650793:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118673.674018:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118673.738590:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566202880:0@lo:400:kworker.0 00000100:00100000:1.0:1787118673.738667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118673.738905:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566202624:0@lo:400:kworker.0 00000100:00100000:2.0:1787118673.738941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118673.738984:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118673.738991:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566202752:0@lo:400:kworker.0 00000100:00100000:2.0:1787118673.739045:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118673.739080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202880 00000100:00100000:2.0:1787118673.739087:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202880 00000100:00100000:2.0:1787118673.739133:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202752 00000100:00100000:2.0:1787118673.739136:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202752 00000100:00100000:2.0:1787118673.739164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787118673.739174:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566202880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118673.741931:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787118673.741955:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566202752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118673.742060:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566202752:12345-0@lo:400:kworker.0 Request processed in 117us (3014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118673.742068:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787118673.742107:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118673.742507:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566203008:0@lo:400:kworker.0 00000100:00100000:3.0:1787118673.742826:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566203264:0@lo:400:kworker.0 00000100:00100000:0.0:1787118673.743024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118673.743106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118673.743126:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118673.743132:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566203136:0@lo:400:kworker.0 00000100:00100000:0.0:1787118673.743159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118673.743185:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203136 00000100:00100000:3.0:1787118673.743279:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203008 00000100:00100000:3.0:1787118673.743285:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203008 00000100:00100000:3.0:1787118673.743331:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203264 00000100:00100000:3.0:1787118673.743334:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203264 00000100:00100000:3.0:1787118673.743357:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787118673.743363:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566203008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118673.743411:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566203008:12345-0@lo:400:kworker.0 Request processed in 48us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118673.743425:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787118673.743442:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787118673.743447:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566203264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118673.743477:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566203264:12345-0@lo:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118673.743482:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787118673.743495:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118673.743497:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118673.743699:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203136 00000100:00100000:0.0:1787118673.743763:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787118673.743770:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566203136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118673.743806:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566203136:12345-0@lo:400:kworker.0 Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118673.743812:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787118673.743848:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566203136:0@lo:400:kworker.0 00010000:00080000:0.0:1787118673.743865:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136eb4f800 x1873929566203264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118673.743875:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566203264:0@lo:400:kworker.0 00010000:00080000:0.0:1787118673.743909:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351521c00 x1873929566203008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118673.743918:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566203008:0@lo:400:kworker.0 00000100:00080000:3.0:1787118673.744125:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118673.744460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566202880:12345-0@lo:400:kworker.0 Request processed in 5285us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118673.744469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787118673.744516:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566202752:0@lo:400:kworker.0 00000100:00100000:1.0:1787118673.744751:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566202880:0@lo:400:kworker.0 00000100:00100000:1.0:1787118673.744778:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566202624 00000100:00100000:1.0:1787118673.744782:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566202624 00000100:00100000:1.0:1787118673.744811:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787118673.744817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566202624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118673.744865:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566202624:12345-0@lo:400:kworker.0 Request processed in 48us (5924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118673.744871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787118673.745011:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566202624:0@lo:400:kworker.0 00000100:00100000:3.0:1787118674.254183:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566203392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118674.254262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118674.254644:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203392 00000100:00100000:2.0:1787118674.254653:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203392 00000100:00100000:2.0:1787118674.255678:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787118674.255708:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566203392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787118674.255782:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118674.255853:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566203392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1592us total) trans 0 rc 0/0 00010000:00080000:3.0:1787118674.258374:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f73d500 x1873929566203392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118674.258401:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566203392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118674.261122:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787118674.702912:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118674.764981:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118674.765007:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96134649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566203520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118674.765069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118674.765317:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203520 00000100:00100000:3.0:1787118674.765325:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203520 00000100:00100000:3.0:1787118674.765366:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787118674.765375:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566203520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118674.765425:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118674.765484:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566203520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118674.765493:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787118674.765641:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96134649ea00 x1873929566203520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118674.765661:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96134649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566203520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787118675.721950:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118676.746022:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118677.213026:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118677.213089:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118677.214191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148096 00000100:00100000:0.0:1787118677.214202:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148096 00000100:00100000:0.0:1787118677.214693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 209 00000100:00100000:0.0:1787118677.214705:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544148096:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118677.214799:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544148096:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 96us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118677.214812:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 209 00000100:00100000:0.0:1787118677.214845:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148224 00000100:00100000:0.0:1787118677.214848:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148224 00000100:00100000:0.0:1787118677.215572:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:0.0:1787118677.215582:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544148224:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118677.215623:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544148224:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 42us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118677.215630:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00080000:0.0:1787118677.217004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787118677.786711:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118678.794935:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118678.861176:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566203648:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118678.861309:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566204160:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118678.861375:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787118678.861382:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566203776:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118678.861432:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566204288:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118678.861482:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204160 00000100:00100000:3.0:1787118678.861488:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204160 00000100:00100000:3.0:1787118678.861529:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203776 00000100:00100000:3.0:1787118678.861531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203776 00000100:00100000:3.0:1787118678.861550:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787118678.861558:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566204160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566204160:12345-0@lo:400:kworker.0 Request processed in 47us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118678.861611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787118678.861627:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787118678.861633:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566203776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861669:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566203776:12345-0@lo:400:kworker.0 Request processed in 36us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118678.861675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787118678.861695:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204288 00000100:00100000:3.0:1787118678.861699:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204288 00000100:00100000:3.0:1787118678.861752:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787118678.861759:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566204288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861789:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566204288:12345-0@lo:400:kworker.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118678.861795:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787118678.861818:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118678.861822:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118678.861930:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566203776:0@lo:400:kworker.0 00010000:00080000:3.0:1787118678.861946:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f727800 x1873929566204288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118678.861956:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566204288:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.861964:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566204160:0@lo:400:kworker.0 00000100:00100000:2.0:1787118678.862191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203648 00000100:00100000:2.0:1787118678.862195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203648 00000100:00100000:2.0:1787118678.862245:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787118678.862253:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566203648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118678.862291:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566203648:12345-0@lo:400:kworker.0 Request processed in 40us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118678.862297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787118678.862508:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566203648:0@lo:400:kworker.0 00000100:00100000:1.0:1787118678.863247:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566203904:0@lo:400:kworker.0 00000100:00100000:1.0:1787118678.863288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118678.863364:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118678.863372:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204032:0@lo:400:kworker.0 00000100:00100000:1.0:1787118678.863395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118678.867439:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204032 00000100:00100000:0.0:1787118678.867453:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204032 00000100:00100000:0.0:1787118678.867527:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787118678.867538:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118678.867629:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204032:12345-0@lo:400:kworker.0 Request processed in 93us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118678.867637:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787118678.867940:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f726d80 x1873929566204032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118678.867964:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204032:0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.870040:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566203904 00000100:00100000:3.0:1787118678.870053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566203904 00000100:00080000:3.0:1787118678.870213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118678.870383:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787118678.870393:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566203904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118678.870485:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566203904:12345-0@lo:400:kworker.0 Request processed in 92us (7195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118678.870493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787118678.870542:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566203904:0@lo:400:kworker.0 00000100:00080000:0.0:1787118678.871140:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118679.373585:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118679.373671:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118679.373944:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204416 00000100:00100000:1.0:1787118679.373955:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204416 00000100:00100000:1.0:1787118679.374007:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787118679.374016:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118679.374051:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118679.374105:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118679.374112:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787118679.374217:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f73ed80 x1873929566204416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118679.374236:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118679.818056:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118679.882056:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118679.882080:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96134649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118679.882147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118679.882388:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204544 00000100:00100000:3.0:1787118679.882396:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204544 00000100:00100000:3.0:1787118679.882448:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787118679.882458:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118679.882492:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118679.882534:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566204544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118679.882541:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787118679.882669:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96134649ed80 x1873929566204544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118679.882688:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96134649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566204544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118680.842352:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787118681.839454:0:10134:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:51:19 (1787118679) === 00010000:00010000:1.0:1787118681.867830:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118682.331572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118682.331620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118682.331661:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148352 00000100:00100000:0.0:1787118682.331672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148352 00000100:00100000:0.0:1787118682.331762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 211 00000100:00100000:0.0:1787118682.331773:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544148352:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118682.331816:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148480 00000100:00100000:3.0:1787118682.331821:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148480 00000100:00100000:0.0:1787118682.331852:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+10:2368:x1873929544148352:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118682.331859:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 211 00000100:00100000:3.0:1787118682.331873:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:3.0:1787118682.331880:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544148480:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118682.331910:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544148480:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.331916:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00080000:1.0:1787118682.331991:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118682.476788:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.476901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148608 00000100:00100000:3.0:1787118682.476909:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148608 00000100:00100000:3.0:1787118682.476966:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 212 00000100:00100000:3.0:1787118682.476977:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+10:8155:x1873929544148608:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787118682.476993:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118682.477011:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d600/0xaa534e3c784f85f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b870 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.477042:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d600/0xaa534e3c784f85f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b870 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.477052:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d600/0xaa534e3c784f85f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b870 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.477079:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d600, rc 0) 00000100:00100000:3.0:1787118682.477152:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544148608:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.477159:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 212 00000100:00100000:0.0:1787118682.479545:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118682.479642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148736 00000100:00100000:2.0:1787118682.479652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148736 00000100:00100000:2.0:1787118682.479747:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 213 00000100:00100000:2.0:1787118682.479758:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544148736:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787118682.480048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544148736:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 291us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118682.480056:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 213 00000100:00100000:2.0:1787118682.484798:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118682.484887:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148864 00000100:00100000:0.0:1787118682.484896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148864 00000100:00100000:0.0:1787118682.484949:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 214 00000100:00100000:0.0:1787118682.484960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544148864:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787118682.485265:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544148864:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 239us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118682.485274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 214 00000100:00100000:0.0:1787118682.504085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.504234:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544148992 00000100:00100000:3.0:1787118682.504243:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544148992 00000100:00100000:3.0:1787118682.504292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 215 00000100:00100000:3.0:1787118682.504310:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+11:8159:x1873929544148992:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118682.504582:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+11:8159:x1873929544148992:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 272us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.504591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 215 00000100:00100000:1.0:1787118682.529961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118682.531000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149120 00000100:00100000:2.0:1787118682.531021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149120 00000100:00100000:2.0:1787118682.531095:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 216 00000100:00100000:2.0:1787118682.531105:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+11:8159:x1873929544149120:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787118682.531378:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+11:8159:x1873929544149120:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 274us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118682.531393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 216 00000100:00100000:2.0:1787118682.539661:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118682.539821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149248 00000100:00100000:0.0:1787118682.539831:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149248 00000100:00100000:0.0:1787118682.539885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 217 00000100:00100000:0.0:1787118682.539895:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:8155:x1873929544149248:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787118682.539910:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118682.539926:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340031a00/0xaa534e3c784f85ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b89a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118682.539952:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340031a00/0xaa534e3c784f85ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b89a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118682.539963:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340031a00/0xaa534e3c784f85ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b89a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118682.539972:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031a00, rc 0) 00000100:00100000:0.0:1787118682.540034:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:8155:x1873929544149248:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118682.540058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 217 00000100:00100000:0.0:1787118682.543711:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.544018:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149376 00000100:00100000:3.0:1787118682.544037:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149376 00000100:00100000:3.0:1787118682.544082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 218 00000100:00100000:3.0:1787118682.544092:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:8155:x1873929544149376:12345-192.168.203.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787118682.544116:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787118682.544138:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787118682.544142:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787118682.544145:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787118682.544147:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787118682.546283:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:8155:x1873929544149376:12345-192.168.203.10@tcp:256:mount.lustre.0 Request processed in 2172us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.546307:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 218 00000100:00100000:2.0:1787118682.555147:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.555450:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149504 00000100:00100000:3.0:1787118682.555459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149504 00000100:00100000:3.0:1787118682.555525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 219 00000100:00100000:3.0:1787118682.555535:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:8155:x1873929544149504:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787118682.555551:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118682.555567:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.555593:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.555604:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118682.555611:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118682.555682:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:8155:x1873929544149504:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 149us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.555690:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 219 00000100:00100000:0.0:1787118682.562850:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.562996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149632 00000100:00100000:3.0:1787118682.563006:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149632 00000100:00100000:3.0:1787118682.563064:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 220 00000100:00100000:3.0:1787118682.563074:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:8155:x1873929544149632:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787118682.563386:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:8155:x1873929544149632:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 312us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.563394:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 220 00000100:00100000:0.0:1787118682.569549:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118682.569657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149760 00000100:00100000:1.0:1787118682.569667:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149760 00000100:00100000:1.0:1787118682.569754:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 221 00000100:00100000:1.0:1787118682.569764:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:8155:x1873929544149760:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787118682.570034:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:8155:x1873929544149760:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 271us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118682.570053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 221 00000100:00100000:2.0:1787118682.576859:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.577127:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544149888 00000100:00100000:3.0:1787118682.577137:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544149888 00000100:00100000:3.0:1787118682.577195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 222 00000100:00100000:3.0:1787118682.577207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:8163:x1873929544149888:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118682.577454:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:8163:x1873929544149888:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 248us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.577462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 222 00000100:00100000:1.0:1787118682.585996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.586398:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150016 00000100:00100000:3.0:1787118682.586409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150016 00000100:00100000:3.0:1787118682.586466:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 223 00000100:00100000:3.0:1787118682.586476:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:8163:x1873929544150016:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118682.586758:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:8163:x1873929544150016:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 283us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.586768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 223 00000100:00100000:2.0:1787118682.600102:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.600981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150144 00000100:00100000:3.0:1787118682.600992:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150144 00000100:00100000:3.0:1787118682.601045:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:3.0:1787118682.601053:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2367:x1873929544150144:12345-192.168.203.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787118682.601079:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 8dad2de5-fb67-450e-b561-ceddc9effe30@192.168.203.10@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787118682.601127:0:5843:0:(genops.c:1406:class_connect()) connect: client 8dad2de5-fb67-450e-b561-ceddc9effe30, cookie 0xaa534e3c784f860d 00000004:00100000:3.0:1787118682.601157:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787118682.601544:0:5843:0:(import.c:65:import_set_state_nolock()) ffff96136eb55000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118682.601676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2367:x1873929544150144:12345-192.168.203.10@tcp:38:mount.lustre.0 Request processed in 621us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.601694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118682.606503:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118682.606548:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118682.606642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150272 00000100:00100000:1.0:1787118682.606651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150272 00000100:00100000:1.0:1787118682.606718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150400 00000100:00100000:1.0:1787118682.606746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150400 00000100:00100000:1.0:1787118682.606772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:1.0:1787118682.606782:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+7:0:x1873929544150272:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787118682.606825:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787118682.606905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+7:0:x1873929544150272:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 124us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118682.606912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118682.607021:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:2.0:1787118682.607038:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+7:8155:x1873929544150400:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787118682.607053:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118682.607080:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+7:8155:x1873929544150400:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 52us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118682.607086:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00080000:0.0:1787118682.608142:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118682.611287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118682.611690:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150528 00000100:00100000:2.0:1787118682.611701:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150528 00000100:00100000:2.0:1787118682.611803:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:2.0:1787118682.611814:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:8155:x1873929544150528:12345-192.168.203.10@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787118682.611887:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:8155:x1873929544150528:12345-192.168.203.10@tcp:40:mount.lustre.0 Request processed in 76us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118682.611894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:2.0:1787118682.622011:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118682.622055:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118682.622636:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150656 00000100:00100000:3.0:1787118682.622646:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150656 00000100:00100000:3.0:1787118682.622697:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150784 00000100:00100000:3.0:1787118682.622701:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150784 00000100:00100000:3.0:1787118682.622776:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:3.0:1787118682.622784:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544150656:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787118682.622814:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 8dad2de5-fb67-450e-b561-ceddc9effe30@192.168.203.10@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787118682.622845:0:6703:0:(genops.c:1406:class_connect()) connect: client 8dad2de5-fb67-450e-b561-ceddc9effe30, cookie 0xaa534e3c784f8614 00002000:00100000:3.0:1787118682.622858:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8dad2de5-fb67-450e-b561-ceddc9effe30/ffff96136eb52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787118682.622881:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787118682.623125:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787118682.623165:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96136eb55800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118682.623226:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2367:x1873929544150656:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 440us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.623233:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:3.0:1787118682.623250:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:3.0:1787118682.623255:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544150784:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787118682.623270:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 8dad2de5-fb67-450e-b561-ceddc9effe30@192.168.203.10@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787118682.623287:0:6703:0:(genops.c:1406:class_connect()) connect: client 8dad2de5-fb67-450e-b561-ceddc9effe30, cookie 0xaa534e3c784f861b 00002000:00100000:3.0:1787118682.623293:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8dad2de5-fb67-450e-b561-ceddc9effe30/ffff96136eb56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787118682.623306:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787118682.623441:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787118682.623457:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96136eb54000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118682.623482:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2367:x1873929544150784:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 226us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118682.623489:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:2.0:1787118682.633856:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118682.634035:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544150912 00000100:00100000:1.0:1787118682.634045:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544150912 00000100:00100000:1.0:1787118682.634323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:1.0:1787118682.634335:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:8155:x1873929544150912:12345-192.168.203.10@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787118682.634573:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787118682.634774:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:8155:x1873929544150912:12345-192.168.203.10@tcp:33:mount.lustre.0 Request processed in 441us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118682.634783:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00010000:00010000:0.0:1787118682.891852:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118683.913995:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118683.979121:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566204800:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979188:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979241:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566205312:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979312:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787118683.979319:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566204672:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979369:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566205184:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979419:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566204928:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979459:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118683.979464:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566205056:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118683.979520:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204800 00000100:00100000:1.0:1787118683.979526:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204800 00000100:00100000:1.0:1787118683.979565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205184 00000100:00100000:1.0:1787118683.979568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205184 00000100:00100000:1.0:1787118683.979593:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204928 00000100:00100000:1.0:1787118683.979595:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204928 00000100:00100000:1.0:1787118683.979612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787118683.979632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566204800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566204800:12345-0@lo:400:kworker.0 Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.979689:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787118683.979705:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787118683.979712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566205184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.979927:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566205184:12345-0@lo:400:kworker.0 Request processed in 214us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.979934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787118683.979955:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787118683.979961:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980008:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566204928:12345-0@lo:400:kworker.0 Request processed in 46us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.980014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787118683.980034:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205312 00000100:00100000:1.0:1787118683.980037:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205312 00000100:00100000:1.0:1787118683.980064:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205056 00000100:00100000:1.0:1787118683.980067:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205056 00000100:00100000:1.0:1787118683.980087:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787118683.980094:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566205312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980126:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566205312:12345-0@lo:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.980133:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787118683.980144:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787118683.980150:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566205056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980178:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566205056:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.980184:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787118683.980200:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566204672 00000100:00100000:1.0:1787118683.980204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566204672 00000100:00100000:1.0:1787118683.980224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787118683.980229:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566204672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980257:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566204672:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118683.980263:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1787118683.980302:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118683.980311:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787118683.980314:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118683.980346:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566204672:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980361:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566205184:0@lo:400:kworker.0 00000100:00100000:1.0:1787118683.980370:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566204800:0@lo:400:kworker.0 00010000:00080000:1.0:1787118683.980381:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd180 x1873929566205312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118683.980391:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566205312:0@lo:400:kworker.0 00010000:00080000:3.0:1787118683.980542:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cf800 x1873929566205056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118683.980565:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566205056:0@lo:400:kworker.0 00000100:00100000:3.0:1787118683.980579:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566204928:0@lo:400:kworker.0 00000100:00100000:1.0:1787118684.490040:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118684.490060:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566205440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118684.490124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118684.490192:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205440 00000100:00100000:1.0:1787118684.490199:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205440 00000100:00100000:1.0:1787118684.490244:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787118684.490252:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566205440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118684.490287:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118684.490329:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566205440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118684.490336:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787118684.490375:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd180 x1873929566205440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118684.490392:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566205440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118684.939847:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118685.002878:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118685.002900:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566205568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118685.002970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118685.011346:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205568 00000100:00100000:1.0:1787118685.011360:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205568 00000100:00100000:1.0:1787118685.011426:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787118685.011437:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566205568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118685.011473:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118685.011552:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566205568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (8582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118685.011559:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787118685.011582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118685.017607:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd180 x1873929566205568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118685.017646:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566205568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118685.961962:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787118686.610749:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00000001:00100000:1.0:1787118686.635251:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00010000:00010000:0.0:1787118686.986215:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787118687.700602:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00000100:00100000:2.0:1787118687.968431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118687.968479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118687.968511:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118687.968533:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118687.968563:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118687.968650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151040 00000100:00100000:3.0:1787118687.968659:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151040 00000100:00100000:3.0:1787118687.968712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 225 00000100:00100000:3.0:1787118687.968754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544151040:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118687.968823:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544151040:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118687.968831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 225 00000100:00100000:1.0:1787118687.969569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151296 00000100:00100000:1.0:1787118687.969575:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151296 00000100:00100000:1.0:1787118687.969638:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151168 00000100:00100000:1.0:1787118687.969641:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151168 00000100:00100000:1.0:1787118687.969671:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:1.0:1787118687.969679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151296:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118687.969756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151296:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118687.969763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:1.0:1787118687.969778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:1.0:1787118687.969784:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544151168:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118687.969809:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544151168:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 25us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118687.969815:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:1.0:1787118687.969833:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151552 00000100:00100000:1.0:1787118687.969849:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151552 00000100:00100000:1.0:1787118687.969875:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151424 00000100:00100000:1.0:1787118687.969878:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151424 00000100:00100000:1.0:1787118687.969896:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:1.0:1787118687.969903:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151552:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118687.969929:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151552:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 27us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118687.969936:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:0.0:1787118687.970146:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00080000:2.0:1787118687.970149:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118687.970153:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118687.970154:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613508f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151424:12345-192.168.203.10@tcp:400:kworker.0 00000100:00080000:2.0:1787118687.970155:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118687.973183:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613508f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544151424:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 3009us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118687.973214:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 42 00010000:00010000:1.0:1787118688.009981:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118689.053136:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118689.098093:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566205696:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098215:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566206208:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098265:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787118689.098271:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566205824:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098293:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098310:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566206336:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098359:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098398:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118689.098403:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566205952:0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098422:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.098449:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205696 00000100:00100000:1.0:1787118689.098456:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205696 00000100:00100000:1.0:1787118689.098498:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787118689.098519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566205696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566205696:12345-0@lo:400:kworker.0 Request processed in 47us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118689.098571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787118689.098614:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206208 00000100:00100000:1.0:1787118689.098617:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206208 00000100:00100000:1.0:1787118689.098643:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205824 00000100:00100000:1.0:1787118689.098646:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205824 00000100:00100000:1.0:1787118689.098655:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566205952 00000100:00100000:1.0:1787118689.098657:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566205952 00000100:00100000:1.0:1787118689.098669:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787118689.098674:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098704:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566206208:12345-0@lo:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118689.098710:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787118689.098745:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118689.098751:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566205824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098795:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566205824:12345-0@lo:400:kworker.0 Request processed in 44us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118689.098801:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118689.098812:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787118689.098818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118689.098845:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566205952:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118689.098850:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787118689.098869:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206336 00000100:00100000:1.0:1787118689.098872:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206336 00000100:00100000:1.0:1787118689.099982:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206080 00000100:00100000:1.0:1787118689.099989:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206080 00000100:00100000:2.0:1787118689.106272:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787118689.106298:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566206336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118689.106391:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566206336:12345-0@lo:400:kworker.0 Request processed in 106us (8057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118689.106399:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787118689.106423:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787118689.106432:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118689.106465:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566206080:12345-0@lo:400:kworker.0 Request processed in 36us (8083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118689.106471:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787118689.107564:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566205824:0@lo:400:kworker.0 00010000:00080000:0.0:1787118689.107583:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc380 x1873929566206336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118689.107602:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566206336:0@lo:400:kworker.0 00000100:00100000:0.0:1787118689.107614:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566205696:0@lo:400:kworker.0 00000100:00100000:0.0:1787118689.107624:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566206208:0@lo:400:kworker.0 00000100:00080000:0.0:1787118689.108093:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118689.108115:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118689.108117:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118689.108644:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566205952:0@lo:400:kworker.0 00010000:00080000:1.0:1787118689.108660:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc700 x1873929566206080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118689.108671:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566206080:0@lo:400:kworker.0 00000001:02000400:1.0:1787118689.483220:0:10331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787118689.609905:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118689.609926:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566206464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118689.609992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118689.610080:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206464 00000100:00100000:1.0:1787118689.610088:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206464 00000100:00100000:1.0:1787118689.610137:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787118689.610145:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566206464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118689.610177:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118689.610215:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566206464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118689.610221:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787118689.610287:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc700 x1873929566206464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118689.610304:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566206464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118690.058471:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118690.122339:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118690.122361:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118690.122442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118690.122649:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206592 00000100:00100000:1.0:1787118690.122657:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206592 00000100:00100000:1.0:1787118690.122709:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787118690.122719:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566206592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118690.122773:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118690.122819:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566206592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118690.122827:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787118690.122969:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cf480 x1873929566206592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118690.122986:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566206592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787118691.085179:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118692.106445:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118693.082859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118693.082914:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118693.082945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118693.082953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151680 00000100:00100000:1.0:1787118693.082964:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151680 00000100:00100000:3.0:1787118693.082972:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118693.083002:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118693.083030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151936 00000100:00100000:1.0:1787118693.083031:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 227 00000100:00100000:3.0:1787118693.083036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151936 00000100:00100000:1.0:1787118693.083045:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544151680:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118693.083078:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544151808 00000100:00100000:3.0:1787118693.083088:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544151808 00000100:00100000:3.0:1787118693.083118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:3.0:1787118693.083132:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544151936:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118693.083133:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544151680:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118693.083146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 227 00000100:00100000:3.0:1787118693.083176:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544151936:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118693.083184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:3.0:1787118693.083203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:3.0:1787118693.083213:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544151808:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118693.083243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544151808:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118693.083250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:3.0:1787118693.083270:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152192 00000100:00100000:3.0:1787118693.083273:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152192 00000100:00100000:3.0:1787118693.083298:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152064 00000100:00100000:3.0:1787118693.083302:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152064 00000100:00100000:3.0:1787118693.083322:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:3.0:1787118693.083379:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544152192:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118693.083411:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544152192:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 36us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118693.083419:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:3.0:1787118693.083431:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:3.0:1787118693.083437:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544152064:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118693.083459:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544152064:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118693.084068:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00080000:3.0:1787118693.084109:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118693.084113:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118693.084116:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787118693.129874:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118694.172370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118694.218183:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566206976:0@lo:400:kworker.0 00000100:00100000:1.0:1787118694.218210:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566206848:0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.218313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118694.218380:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566206720:0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.218431:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118694.218440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118694.218448:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566207104:0@lo:400:kworker.0 00000100:00100000:0.0:1787118694.218497:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566207232:0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.218499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118694.218546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118694.218573:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207104 00000100:00100000:3.0:1787118694.218585:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207104 00000100:00100000:0.0:1787118694.218623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206720 00000100:00100000:0.0:1787118694.218631:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206720 00000100:00100000:3.0:1787118694.218680:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787118694.218686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787118694.218698:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566207104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118694.218702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566206720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118694.218811:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566206720:12345-0@lo:400:kworker.0 Request processed in 114us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118694.218821:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566207104:12345-0@lo:400:kworker.0 Request processed in 129us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118694.218823:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787118694.218842:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787118694.218882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206976 00000100:00100000:3.0:1787118694.218887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206976 00000100:00100000:0.0:1787118694.218902:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566206720:0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.218930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207232 00000100:00100000:3.0:1787118694.218936:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207232 00000100:00100000:3.0:1787118694.218970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787118694.218978:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.219014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566206976:12345-0@lo:400:kworker.0 Request processed in 37us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118694.219020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787118694.219034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787118694.219043:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566207232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118694.219058:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118694.219089:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566207360:0@lo:400:kworker.0 00000100:00100000:2.0:1787118694.219122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118694.219194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566206848 00000100:00100000:0.0:1787118694.219205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566206848 00000100:00100000:0.0:1787118694.219238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787118694.219250:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566206848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118694.219321:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566206848:12345-0@lo:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118694.219329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787118694.219367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566207232:12345-0@lo:400:kworker.0 Request processed in 324us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118694.219390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787118694.219405:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566206848:0@lo:400:kworker.0 00000100:00080000:3.0:1787118694.219422:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118694.219430:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118694.219446:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207360 00000100:00100000:3.0:1787118694.219451:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207360 00000100:00100000:3.0:1787118694.219501:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787118694.219511:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566207360:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787118694.219516:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118694.219576:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566207360:12345-0@lo:400:kworker.0 Request processed in 66us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118694.219583:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787118694.219633:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f725500 x1873929566207360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118694.219645:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566207360:0@lo:400:kworker.0 00010000:00080000:3.0:1787118694.219707:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f726680 x1873929566207104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118694.219744:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566207104:0@lo:400:kworker.0 00000100:00100000:3.0:1787118694.219760:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566206976:0@lo:400:kworker.0 00000100:00100000:1.0:1787118694.220504:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566207232:0@lo:400:kworker.0 00000100:00100000:1.0:1787118694.732048:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118694.732079:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566207488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118694.732292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118694.732393:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207488 00000100:00100000:1.0:1787118694.732402:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207488 00000100:00100000:1.0:1787118694.732464:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787118694.732476:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566207488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118694.732523:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118694.732587:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566207488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118694.732595:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787118694.732645:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd880 x1873929566207488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118694.732667:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566207488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118695.183307:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118695.242462:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118695.242486:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566207616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118695.242560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118695.249369:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207616 00000100:00100000:1.0:1787118695.249382:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207616 00000100:00100000:1.0:1787118695.249439:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787118695.249457:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566207616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118695.249492:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118695.249580:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566207616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (7019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118695.249587:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787118695.249629:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd880 x1873929566207616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118695.249648:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566207616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118696.208898:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118697.237765:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118698.203801:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118698.203887:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118698.203915:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118698.203936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118698.203958:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118698.203989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152576 00000100:00100000:0.0:1787118698.203997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152576 00000100:00100000:0.0:1787118698.204059:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152448 00000100:00100000:0.0:1787118698.204063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152448 00000100:00100000:0.0:1787118698.204088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:0.0:1787118698.204104:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152576:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118698.204172:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152576:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118698.204180:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:0.0:1787118698.204197:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:0.0:1787118698.204204:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544152448:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118698.204228:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544152448:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118698.204234:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:0.0:1787118698.204261:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152832 00000100:00100000:0.0:1787118698.204265:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152832 00000100:00100000:0.0:1787118698.204289:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152704 00000100:00100000:0.0:1787118698.204293:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152704 00000100:00100000:0.0:1787118698.204311:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:0.0:1787118698.204317:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152832:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118698.204343:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152832:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118698.204350:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:0.0:1787118698.204362:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:0.0:1787118698.204368:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152704:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118698.204391:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544152704:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 23us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118698.204397:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:2.0:1787118698.204860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152320 00000100:00100000:2.0:1787118698.204866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152320 00000100:00100000:2.0:1787118698.204904:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 229 00000100:00100000:2.0:1787118698.204911:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544152320:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118698.204955:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544152320:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 44us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118698.204962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 229 00000100:00080000:2.0:1787118698.204989:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118698.204994:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787118698.204997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118698.249947:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118699.274086:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118699.338445:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566208000:0@lo:400:kworker.0 00000100:00100000:1.0:1787118699.338513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.338679:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566207744:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.338712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.338767:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208000 00000100:00100000:0.0:1787118699.338774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208000 00000100:00100000:0.0:1787118699.338834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787118699.338844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566208000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118699.338887:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566207872:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.338888:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566208000:12345-0@lo:400:kworker.0 Request processed in 47us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.338895:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787118699.338916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207744 00000100:00100000:2.0:1787118699.338927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.338929:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207744 00000100:00100000:2.0:1787118699.338951:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566208128:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.338953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787118699.338959:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566207744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118699.338976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.339000:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566207744:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.339007:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1787118699.339030:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118699.339041:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566207872 00000100:00100000:0.0:1787118699.339044:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566207872 00000100:00100000:0.0:1787118699.339064:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787118699.339069:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566207872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.339101:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566207872:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.339107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787118699.339128:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208128 00000100:00100000:0.0:1787118699.339131:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208128 00000100:00100000:0.0:1787118699.339181:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787118699.339188:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566208128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787118699.339220:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118699.339222:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566208128:12345-0@lo:400:kworker.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.339228:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787118699.339595:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566208000:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.340078:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566207744:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.340087:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566208256:0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.340119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.340211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208256 00000100:00100000:0.0:1787118699.340215:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208256 00000100:00100000:0.0:1787118699.340251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787118699.340268:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566208256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.340306:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566208256:12345-0@lo:400:kworker.0 Request processed in 40us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.340312:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1787118699.340327:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118699.340345:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566208256:0@lo:400:kworker.0 00000100:00100000:1.0:1787118699.340543:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566207872:0@lo:400:kworker.0 00000100:00100000:1.0:1787118699.340550:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566208384:0@lo:400:kworker.0 00000100:00100000:1.0:1787118699.340588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118699.340703:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208384 00000100:00100000:0.0:1787118699.340707:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208384 00000100:00100000:0.0:1787118699.340770:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787118699.340777:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566208384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118699.340813:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566208384:12345-0@lo:400:kworker.0 Request processed in 37us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118699.340819:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787118699.340847:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cea00 x1873929566208128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118699.340857:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566208128:0@lo:400:kworker.0 00010000:00080000:0.0:1787118699.340878:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc380 x1873929566208384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118699.340887:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566208384:0@lo:400:kworker.0 00000100:00080000:1.0:1787118699.340951:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118699.858037:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566208512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118699.858109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118699.858176:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208512 00000100:00100000:1.0:1787118699.858184:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208512 00000100:00100000:1.0:1787118699.858228:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787118699.858237:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566208512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118699.858273:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118699.858317:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566208512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118699.858338:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787118699.858393:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136eb4ca80 x1873929566208512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118699.858412:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566208512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118700.299101:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118700.362650:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118700.362674:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566208640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118700.362768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118700.362919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208640 00000100:00100000:2.0:1787118700.362927:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208640 00000100:00100000:2.0:1787118700.362988:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787118700.362998:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566208640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118700.363037:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118700.363094:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566208640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118700.363101:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787118700.363172:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f727480 x1873929566208640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118700.363190:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566208640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787118701.324053:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118702.345931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118703.324975:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118703.325019:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118703.325060:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118703.325090:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153344 00000100:00100000:0.0:1787118703.325099:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153344 00000100:00100000:0.0:1787118703.325159:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:0.0:1787118703.325170:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2367:x1873929544153344:12345-192.168.203.10@tcp:9:kworker.0 00000020:00000080:0.0:1787118703.325199:0:6703:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8614 00000100:00080000:0.0:1787118703.325209:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96136eb55800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787118703.325243:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787118703.325614:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+2:2367:x1873929544153344:12345-192.168.203.10@tcp:9:kworker.0 Request processed in 445us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118703.325623:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00080000:0.0:1787118703.325644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787118703.325657:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118703.325827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544152960 00000100:00100000:2.0:1787118703.325833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544152960 00000100:00100000:2.0:1787118703.325876:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 231 00000100:00100000:2.0:1787118703.325884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544152960:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118703.325920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544152960:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 38us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118703.325927:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 231 00000100:00100000:3.0:1787118703.326457:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153088 00000100:00100000:3.0:1787118703.326463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153088 00000100:00100000:3.0:1787118703.326567:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:3.0:1787118703.326576:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544153088:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118703.326619:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544153088:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 44us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118703.326636:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00080000:0.0:1787118703.326892:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118703.333424:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118703.333508:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153472 00000100:00100000:2.0:1787118703.333516:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153472 00000100:00100000:2.0:1787118703.333583:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:2.0:1787118703.333599:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2367:x1873929544153472:12345-192.168.203.10@tcp:9:kworker.0 00000020:00000080:2.0:1787118703.333629:0:8419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f861b 00000100:00080000:2.0:1787118703.333638:0:8419:0:(import.c:65:import_set_state_nolock()) ffff96136eb54000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787118703.333674:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787118703.334025:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+2:2367:x1873929544153472:12345-192.168.203.10@tcp:9:kworker.0 Request processed in 432us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118703.334033:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00010000:00010000:2.0:1787118703.334055:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787118703.334291:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118703.334510:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118703.334573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153216 00000100:00100000:2.0:1787118703.334578:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153216 00000100:00100000:2.0:1787118703.334631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00100000:2.0:1787118703.334640:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544153216:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118703.334683:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544153216:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118703.334690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00080000:0.0:1787118703.334921:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118703.372787:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118704.394368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118704.458643:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566208768:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.458717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118704.459464:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566209280:0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118704.459554:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787118704.459561:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566208896:0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118704.459604:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566209408:0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118704.459657:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209280 00000100:00100000:2.0:1787118704.459672:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209280 00000100:00100000:2.0:1787118704.459740:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208896 00000100:00100000:2.0:1787118704.459744:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208896 00000100:00100000:2.0:1787118704.459775:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787118704.459784:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566209280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459830:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566209280:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118704.459837:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787118704.459851:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787118704.459858:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566208896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459882:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566208896:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118704.459887:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787118704.459923:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566208896:0@lo:400:kworker.0 00000100:00100000:2.0:1787118704.459933:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566209280:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.460171:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566209024:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.460198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118704.460232:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118704.460472:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209024 00000100:00100000:1.0:1787118704.460477:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209024 00000100:00100000:1.0:1787118704.460520:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787118704.460527:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566209024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118704.460560:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566209024:12345-0@lo:400:kworker.0 Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118704.460566:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787118704.460604:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566209152:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.460641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118704.460676:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566209024:0@lo:400:kworker.0 00000100:00100000:0.0:1787118704.460756:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209408 00000100:00100000:0.0:1787118704.460760:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209408 00000100:00100000:0.0:1787118704.460792:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209152 00000100:00100000:0.0:1787118704.460794:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209152 00000100:00100000:0.0:1787118704.460811:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787118704.460816:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566209408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118704.460851:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566209408:12345-0@lo:400:kworker.0 Request processed in 35us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118704.460857:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787118704.460867:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787118704.460872:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118704.460905:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566209152:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118704.460911:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787118704.460925:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118704.460928:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118704.460931:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118704.460940:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566208768 00000100:00100000:0.0:1787118704.460943:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566208768 00000100:00100000:0.0:1787118704.461028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787118704.461034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566208768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118704.461062:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566208768:12345-0@lo:400:kworker.0 Request processed in 29us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118704.461068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00080000:0.0:1787118704.461100:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cd880 x1873929566209152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118704.461110:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566209152:0@lo:400:kworker.0 00010000:00080000:3.0:1787118704.461453:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4dc00 x1873929566209408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118704.461463:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566209408:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.461472:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566208768:0@lo:400:kworker.0 00000100:00100000:3.0:1787118704.970111:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566209536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118704.970183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118704.970359:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209536 00000100:00100000:1.0:1787118704.970366:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209536 00000100:00100000:1.0:1787118704.970418:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787118704.970429:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566209536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118704.970464:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118704.970525:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566209536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118704.970532:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787118704.970603:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4ce00 x1873929566209536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118704.970623:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566209536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118705.418711:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118705.484907:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566209664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118705.484979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118705.485214:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209664 00000100:00100000:1.0:1787118705.485221:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209664 00000100:00100000:1.0:1787118705.485275:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787118705.485283:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566209664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118705.485315:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118705.489186:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566209664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3893us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118705.489200:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787118705.491135:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f726680 x1873929566209664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118705.491181:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566209664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118706.442337:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787118707.123904:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00000020:00000080:2.0:1787118707.123913:0:7647:0:(genops.c:906:class_export_put()) final put ffff96136eb56800/8dad2de5-fb67-450e-b561-ceddc9effe30 00000020:00000080:0.0:1787118707.124066:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb56800/8dad2de5-fb67-450e-b561-ceddc9effe30 for lustre-OST0001 00000020:00000080:0.0:1787118707.124120:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136eb54000 for lustre-OST0001 00010000:00010000:2.0:1787118707.466604:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787118707.793436:0:11033:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1787118708.075533:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00000020:00000080:0.0:1787118708.075542:0:6728:0:(genops.c:906:class_export_put()) final put ffff96136eb52800/8dad2de5-fb67-450e-b561-ceddc9effe30 00000020:00000080:0.0:1787118708.075567:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb52800/8dad2de5-fb67-450e-b561-ceddc9effe30 for lustre-OST0000 00000020:00000080:0.0:1787118708.075604:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136eb55800 for lustre-OST0000 00000100:00100000:2.0:1787118708.447242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118708.447285:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118708.447321:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118708.447417:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153856 00000100:00100000:1.0:1787118708.447426:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153856 00000100:00100000:1.0:1787118708.447502:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153728 00000100:00100000:1.0:1787118708.447505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153728 00000100:00100000:1.0:1787118708.447536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:1.0:1787118708.447545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544153856:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118708.447616:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544153856:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118708.447624:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:1.0:1787118708.447640:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:1.0:1787118708.447647:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544153728:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118708.447671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544153728:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118708.447678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00080000:2.0:1787118708.447813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118708.448696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153600 00000100:00100000:0.0:1787118708.448704:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153600 00000100:00100000:0.0:1787118708.448815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 233 00000100:00100000:0.0:1787118708.448837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544153600:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118708.449512:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544153600:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 672us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118708.449579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 233 00010000:00010000:1.0:1787118708.490870:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118709.514209:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118709.582392:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566209792:0@lo:400:kworker.0 00000100:00100000:0.0:1787118709.582476:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118709.582534:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566210304:0@lo:400:kworker.0 00000100:00100000:0.0:1787118709.582560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118709.582592:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787118709.582597:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566209920:0@lo:400:kworker.0 00000100:00100000:0.0:1787118709.582620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118709.582638:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566210432:0@lo:400:kworker.0 00000100:00100000:0.0:1787118709.582662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118709.582691:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566210048:0@lo:400:kworker.0 00000100:00100000:0.0:1787118709.582712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118709.582966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210304 00000100:00100000:1.0:1787118709.582974:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210304 00000100:00100000:1.0:1787118709.583019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209920 00000100:00100000:1.0:1787118709.583022:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209920 00000100:00100000:1.0:1787118709.583034:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210048 00000100:00100000:1.0:1787118709.583036:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210048 00000100:00100000:1.0:1787118709.583055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787118709.583063:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566210304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118709.583119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566210304:12345-0@lo:400:kworker.0 Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118709.583139:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787118709.583156:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787118709.583162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566209920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118709.583190:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566209920:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118709.583197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787118709.583207:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787118709.583213:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566210048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118709.583239:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566210048:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118709.583245:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787118709.583314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566209792 00000100:00100000:2.0:1787118709.583319:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566209792 00000100:00100000:2.0:1787118709.583357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787118709.583365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566209792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.583405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566209792:12345-0@lo:400:kworker.0 Request processed in 41us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118709.583412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1787118709.583438:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118709.583476:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210432 00000100:00100000:2.0:1787118709.583480:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210432 00000100:00100000:2.0:1787118709.583512:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787118709.583519:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566210432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.583549:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566210432:12345-0@lo:400:kworker.0 Request processed in 32us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118709.583556:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787118709.583576:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118709.583611:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566209920:0@lo:400:kworker.0 00010000:00080000:2.0:1787118709.583626:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4ea00 x1873929566210432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118709.583637:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566210432:0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.583646:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566209792:0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.583655:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566210304:0@lo:400:kworker.0 00000100:00100000:3.0:1787118709.583987:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210176:0@lo:400:kworker.0 00000100:00100000:3.0:1787118709.584020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118709.584106:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566210048:0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.584207:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210176 00000100:00100000:2.0:1787118709.584211:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210176 00000100:00100000:2.0:1787118709.584259:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787118709.584268:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118709.584353:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210176:12345-0@lo:400:kworker.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118709.584372:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787118709.584467:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787118709.588107:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4f480 x1873929566210176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118709.588125:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210176:0@lo:400:kworker.0 00000100:00100000:3.0:1787118710.090088:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118710.090112:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118710.090183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118710.090284:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210560 00000100:00100000:1.0:1787118710.090292:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210560 00000100:00100000:1.0:1787118710.090343:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787118710.090352:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118710.090386:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118710.090431:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118710.090437:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787118710.090526:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4f480 x1873929566210560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118710.090545:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787118710.538031:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118710.605548:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118710.605669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118710.606967:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210688 00000100:00100000:1.0:1787118710.606976:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210688 00000100:00100000:1.0:1787118710.607037:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787118710.607058:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118710.607093:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118710.610855:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566210688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3789us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118710.610869:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787118710.611000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc380 x1873929566210688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118710.611032:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566210688:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787118711.450094:0:11181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8cf8d500 20000000:00000080:1.0:1787118711.450111:0:11181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96137a4ce400 uarg=0000000000000000 20000000:01000000:1.0:1787118711.450148:0:11181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787118711.450153:0:11181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787118711.450158:0:11181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787118711.451406:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787118711.451657:0:11181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787118711.466880:0:11181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787118711.466922:0:11181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466943:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466951:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466958:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466964:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466971:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.466994:0:11181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.467511:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.467527:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 12 pid: 5835 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.467543:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566210816:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118711.467660:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.467668:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.467677:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566210944:0@lo:104: 00000100:00100000:1.0:1787118711.467713:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118711.468140:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.468150:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.468159:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211072:0@lo:104: 00000100:00100000:1.0:1787118711.468185:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118711.468542:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.468565:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.468575:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211200:0@lo:104: 00000100:00100000:1.0:1787118711.468598:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118711.469387:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118711.469399:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.469410:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211328:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118711.469480:0:11181:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118711.470223:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566210944 00000100:00100000:3.0:1787118711.470309:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566210944 00000100:00100000:3.0:1787118711.470352:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211072 00000100:00100000:3.0:1787118711.470356:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211072 00000100:00100000:3.0:1787118711.470368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211200 00000100:00100000:3.0:1787118711.470371:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211200 00000100:00100000:3.0:1787118711.470385:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118711.470394:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:11181:x1873929566210944:12345-0@lo:104: 00010000:00010000:3.0:1787118711.470406:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.470616:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118711.470622:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+5:11181:x1873929566210944:12345-0@lo:104: Request processed in 229us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118711.470630:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118711.470648:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787118711.470655:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:11181:x1873929566211072:12345-0@lo:104: 00010000:00010000:3.0:1787118711.470664:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118711.470949:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566210944:0@lo:104: 00000100:00100000:1.0:1787118711.470959:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211072:0@lo:104: 00010000:00010000:0.0:1787118711.471187:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787118711.471194:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471202:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118711.471206:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471227:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118711.471312:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118711.471318:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787118711.471385:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471392:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118711.471424:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471440:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136e986e00/0xaa534e3c784f85ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471452:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118711.471455:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471460:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118711.471463:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.471470:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118711.471476:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118711.471486:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787118711.471523:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566211456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118711.471564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118711.471613:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211456 00000100:00100000:2.0:1787118711.471617:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211456 00010000:00010000:2.0:1787118711.471645:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118711.471670:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787118711.471678:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350046050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566211456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118711.471688:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118711.471693:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.471702:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.471714:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986400/0xaa534e3c784f85f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f85ea expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.471741:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118711.471785:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350046050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3298:x1873929566211456:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118711.471791:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787118711.471838:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566211456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787118711.472344:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787118711.472351:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:11181:x1873929566211072:12345-0@lo:104: Request processed in 1697us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118711.472359:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787118711.472378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787118711.472387:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11181:x1873929566211200:12345-0@lo:104: 00010000:00010000:3.0:1787118711.472396:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.472585:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118711.472590:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11181:x1873929566211200:12345-0@lo:104: Request processed in 206us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118711.472596:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787118711.472619:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118711.472624:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.472645:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118711.472648:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.472655:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118711.472661:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118711.472667:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787118711.472765:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211200:0@lo:104: 00010000:00010000:2.0:1787118711.473550:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118711.474013:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566210816:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118711.474025:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873929566211328:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118711.474057:0:11181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.474172:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.474180:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118711.474195:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.474201:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136e987600/0xaa534e3c784f85dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85e3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.474213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118711.474215:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118711.474217:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118711.474347:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566211584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787118711.474391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118711.474986:0:8462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.474994:0:8462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118711.475020:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.475026:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c9400/0xaa534e3c784f85ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f85d5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118711.475040:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118711.475041:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118711.475043:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118711.475059:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118711.475069:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566211712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787118711.475102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118711.475388:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118711.475504:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211584 00000100:00100000:2.0:1787118711.475523:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211584 00010000:00010000:2.0:1787118711.475555:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118711.475587:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211712 00000100:00100000:2.0:1787118711.475591:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211712 00010000:00010000:2.0:1787118711.475608:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118711.475619:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544153984 00000100:00100000:2.0:1787118711.475621:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544153984 00010000:00010000:2.0:1787118711.475633:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 13 pid: 5835 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118711.475646:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118711.475654:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566211584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118711.475667:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118711.475672:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.475681:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.475695:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986600/0xaa534e3c784f85e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f85dc expref: 19 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118711.475708:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118711.475889:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118711.476186:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154112 00000100:00100000:0.0:1787118711.476191:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154112 00010000:00010000:0.0:1787118711.476208:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 14 pid: 5836 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118711.476224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787118711.476317:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3301:x1873929566211712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118711.476330:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118711.476335:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476345:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476363:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8c00/0xaa534e3c784f85d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f85ce expref: 18 pid: 5835 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476371:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118711.476403:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3301:x1873929566211712:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118711.476409:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787118711.476526:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:0.0:1787118711.476533:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+14:2369:x1873929544153984:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118711.476541:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118711.476545:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 14 pid: 5835 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476555:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 14 pid: 5835 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476564:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8ce00/0xaa534e3c784f8606 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8a1 expref: 14 pid: 5835 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476572:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118711.476602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544153984:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 70us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118711.476607:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:0.0:1787118711.476617:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:0.0:1787118711.476622:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+12:2369:x1873929544154112:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118711.476628:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118711.476638:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476647:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476656:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f85c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b869 expref: 12 pid: 5836 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476667:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476674:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476688:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476694:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476701:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476708:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476714:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118711.476718:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.476744:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.478553:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.478567:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118711.478615:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+11:2369:x1873929544154112:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 1989us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118711.478626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:2.0:1787118711.479362:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3299:x1873929566211584:12345-0@lo:103:ldlm_bl.0 Request processed in 3706us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118711.479371:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118711.479496:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566211584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118711.480586:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566211712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118711.481988:0:11181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.482002:0:11181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.482009:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f8622 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118711.571016:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118712.593620:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118712.602371:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118712.605064:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154240 00000100:00100000:1.0:1787118712.605077:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154240 00000100:00100000:1.0:1787118712.605149:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 235 00000100:00100000:1.0:1787118712.605158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:5611:x1873929544154240:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118712.605200:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118712.605220:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118712.605248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118712.605259:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118712.605268:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9000, rc 0) 00000100:00100000:1.0:1787118712.605335:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154240:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 177us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118712.605341:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 235 00000100:00100000:2.0:1787118712.609804:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118712.610903:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154368 00000100:00100000:1.0:1787118712.610918:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154368 00000100:00100000:1.0:1787118712.610994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 236 00000100:00100000:1.0:1787118712.611014:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154368:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118712.611388:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154368:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 380us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118712.611399:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 236 00000100:00100000:3.0:1787118712.617210:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118712.617267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154496 00000100:00100000:3.0:1787118712.617280:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154496 00000100:00100000:3.0:1787118712.617348:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 237 00000100:00100000:3.0:1787118712.617359:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154496:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118712.617698:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154496:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 339us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118712.617708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 237 00000100:00100000:2.0:1787118712.622229:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118712.622369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154624 00000100:00100000:3.0:1787118712.622383:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154624 00000100:00100000:3.0:1787118712.622526:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 238 00000100:00100000:3.0:1787118712.622540:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544154624:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118712.622562:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118712.622585:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8d2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118712.623455:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118712.623472:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118712.623484:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c600, rc 0) 00000100:00100000:3.0:1787118712.623568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544154624:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 1030us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118712.623576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 238 00000100:00100000:3.0:1787118712.626130:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118712.626252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154752 00000100:00100000:1.0:1787118712.626265:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154752 00000100:00100000:1.0:1787118712.626452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 239 00000100:00100000:1.0:1787118712.626464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544154752:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118712.630407:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544154752:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 3832us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118712.630445:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 239 00000100:00100000:2.0:1787118712.632764:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118712.633438:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544154880 00000100:00100000:3.0:1787118712.633452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544154880 00000100:00100000:3.0:1787118712.633651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 240 00000100:00100000:3.0:1787118712.633664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544154880:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118712.634029:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544154880:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 367us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118712.634038:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 240 10000000:01000000:1.0:1787118713.417943:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787118713.417949:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137a707800 from 7 10000000:01000000:1.0:1787118713.417954:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787118713.417998:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118713.418010:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118713.418020:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118713.418044:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566211840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.418610:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118713.418675:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118713.419330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211840 00000100:00100000:3.0:1787118713.419339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211840 00000100:00100000:3.0:1787118713.419403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787118713.419412:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566211840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118713.419438:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118713.419453:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8637 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.419594:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.419607:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.419616:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118713.419675:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566211840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118713.419681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787118713.419840:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566211840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118713.419857:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.419867:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118713.419926:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566211968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.419958:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118713.419988:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118713.420445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566211968 00000100:00100000:1.0:1787118713.420452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566211968 00000100:00100000:1.0:1787118713.421463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787118713.421493:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566211968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.421785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566211968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118713.421793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787118713.425738:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566211968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.425806:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.425947:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118713.425997:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118713.426152:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212096 00000100:00100000:3.0:1787118713.426160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212096 00000100:00100000:3.0:1787118713.426211:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787118713.426228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566212096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118713.427146:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566212096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 917us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118713.427156:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787118713.427309:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787118713.430210:0:11238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787118713.432992:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787118713.433034:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118713.433045:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.433117:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118713.433128:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787118713.433131:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375697800 from 7 10000000:01000000:0.0:1787118713.433134:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118713.433169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.433296:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.433310:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118713.433335:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.433469:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118713.433698:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118713.433815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212224 00000100:00100000:1.0:1787118713.433823:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212224 00000100:00100000:0.0:1787118713.434036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787118713.434046:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566212224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118713.434067:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118713.434080:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8645 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.434104:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.434129:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.434138:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031000, rc 0) 00000100:00100000:0.0:1787118713.434197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118713.434208:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787118713.434285:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118713.434301:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118713.434310:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118713.434380:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.434410:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118713.435057:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787118713.435220:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212352 00000100:00100000:3.0:1787118713.435228:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212352 00000100:00100000:3.0:1787118713.435265:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787118713.435272:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118713.435804:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118713.435812:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787118713.435932:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118713.435971:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118713.436007:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118713.436029:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350e89900 going to sleep for 11 seconds 00000100:00100000:3.0:1787118713.436040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212480 00000100:00100000:3.0:1787118713.436044:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212480 00000100:00100000:3.0:1787118713.436125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787118713.436131:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118713.436305:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118713.436312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787118713.436482:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787118713.437958:0:11239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787118713.438672:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787118713.438692:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118713.438702:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.438714:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118713.438896:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787118713.438898:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961347c3c800 from 7 10000000:01000000:0.0:1787118713.438901:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118713.438937:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.438946:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118713.438957:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118713.438979:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.439114:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118713.439208:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118713.439289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212608 00000100:00100000:3.0:1787118713.439303:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212608 00000100:00100000:3.0:1787118713.439389:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787118713.439398:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566212608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118713.439410:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118713.439432:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8653 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.439456:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.439467:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.439483:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d800, rc 0) 00000100:00100000:3.0:1787118713.439538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566212608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118713.439545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787118713.439609:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118713.439628:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118713.439637:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118713.439691:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118713.439716:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118713.440097:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787118713.440251:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212736 00000100:00100000:0.0:1787118713.440256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212736 00000100:00100000:0.0:1787118713.440280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787118713.440287:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566212736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.440702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566212736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 413us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118713.440710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787118713.440768:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.440804:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.440919:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118713.440942:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118713.440954:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212864 00000100:00100000:0.0:1787118713.440958:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212864 00000100:00100000:0.0:1787118713.440976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787118713.440982:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566212864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118713.441233:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566212864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118713.441240:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787118713.441276:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566212864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787118713.442665:0:11240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787118713.442979:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787118713.443000:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787118713.443010:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118713.443022:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118713.561883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118713.561928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118713.561960:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118713.561993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155008 00000100:00100000:2.0:1787118713.562002:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155008 00000100:00100000:1.0:1787118713.562503:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155136 00000100:00100000:1.0:1787118713.562509:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155136 00000100:00080000:3.0:1787118713.562572:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118713.562574:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155264 00000100:00100000:1.0:1787118713.562579:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155264 00000100:00100000:3.0:1787118713.562605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:3.0:1787118713.562618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544155136:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118713.562693:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544155136:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118713.563191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 250 00000100:00100000:2.0:1787118713.563209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544155008:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118713.563323:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544155008:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 123us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118713.563330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 250 00000100:00080000:2.0:1787118713.565172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118713.567961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:1.0:1787118713.567992:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544155264:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118713.568089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544155264:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 106us (6128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118713.568098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:3.0:1787118713.574251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 96 00010000:00010000:2.0:1787118713.611848:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118714.633921:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118714.705098:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566212992:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705165:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.705235:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566212992 00000100:00100000:3.0:1787118714.705241:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566212992 00000100:00100000:3.0:1787118714.705282:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787118714.705290:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566212992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705337:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566212992:12345-0@lo:400:kworker.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.705345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787118714.705393:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566212992:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705445:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566213120:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.705504:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213120 00000100:00100000:3.0:1787118714.705508:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213120 00000100:00100000:3.0:1787118714.705533:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118714.705540:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566213120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705573:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566213120:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.705579:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118714.705605:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566213120:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705633:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566213248:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.705696:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213248 00000100:00100000:3.0:1787118714.705699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213248 00000100:00100000:3.0:1787118714.705759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787118714.705767:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.705801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566213248:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.705808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787118714.707155:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118714.707202:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566213248:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707263:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118714.707271:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566213376:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.707352:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213376 00000100:00100000:3.0:1787118714.707357:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213376 00000100:00100000:3.0:1787118714.707403:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787118714.707420:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707464:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566213376:12345-0@lo:400:kworker.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.707471:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787118714.707489:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787118714.707508:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613500e8a80 x1873929566213376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118714.707519:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566213376:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707548:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566213504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.707597:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213504 00000100:00100000:3.0:1787118714.707610:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213504 00000100:00100000:3.0:1787118714.707638:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787118714.707644:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566213504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707681:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566213504:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.707687:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1787118714.707700:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118714.707719:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566213504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707769:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566213632:0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.707794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118714.709926:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213632 00000100:00100000:3.0:1787118714.709936:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213632 00000100:00100000:3.0:1787118714.710005:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787118714.710085:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566213632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118714.710163:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566213632:12345-0@lo:400:kworker.0 Request processed in 151us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118714.710170:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787118714.710212:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613500e8a80 x1873929566213632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118714.710225:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566213632:0@lo:400:kworker.0 00000100:00080000:0.0:1787118714.710332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118715.210139:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118715.210163:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566213760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118715.210227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118715.217081:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213760 00000100:00100000:1.0:1787118715.217096:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213760 00000100:00100000:1.0:1787118715.217222:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787118715.217232:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566213760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118715.217269:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118715.217358:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566213760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (7131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118715.217366:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787118715.217479:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4e680 x1873929566213760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118715.217499:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566213760:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787118715.639572:0:11380:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787118715.660903:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118715.726774:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566213888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118715.726844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118715.726924:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566213888 00000100:00100000:2.0:1787118715.726941:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566213888 00000100:00100000:2.0:1787118715.726988:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787118715.726997:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566213888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118715.727030:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118715.727089:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566213888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118715.727096:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787118715.727131:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9cc380 x1873929566213888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118715.727159:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566213888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118716.681950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118717.711823:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118718.683631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118718.683667:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118718.683697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118718.683776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155648 00000100:00100000:0.0:1787118718.683796:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155648 00000100:00100000:0.0:1787118718.683857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155520 00000100:00100000:0.0:1787118718.683859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155520 00000100:00100000:0.0:1787118718.683878:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:0.0:1787118718.683886:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544155648:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118718.683950:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544155648:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118718.683957:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:0.0:1787118718.683970:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 102 00000100:00100000:0.0:1787118718.683976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544155520:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118718.683994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544155520:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 19us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118718.684010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 102 00000100:00080000:2.0:1787118718.684274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118718.685644:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155392 00000100:00100000:3.0:1787118718.685653:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155392 00000100:00100000:3.0:1787118718.685717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 252 00000100:00100000:3.0:1787118718.685762:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544155392:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118718.685816:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544155392:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 56us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118718.685823:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 252 00010000:00010000:3.0:1787118718.729886:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118719.759461:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118719.818456:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566214016:0@lo:400:kworker.0 00000100:00100000:2.0:1787118719.818561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118719.818625:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566214528:0@lo:400:kworker.0 00000100:00100000:2.0:1787118719.818655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118719.818679:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118719.818685:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566214400:0@lo:400:kworker.0 00000100:00100000:2.0:1787118719.818707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118719.818797:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566214144:0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.818827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118719.818854:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566214656:0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.818872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118719.818899:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118719.818904:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566214272:0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.818922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118719.818953:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214400 00000100:00100000:3.0:1787118719.818960:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214400 00000100:00100000:3.0:1787118719.819014:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214656 00000100:00100000:3.0:1787118719.819016:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214656 00000100:00100000:3.0:1787118719.819036:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118719.819044:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566214400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819094:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566214400:12345-0@lo:400:kworker.0 Request processed in 51us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118719.819101:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118719.819117:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787118719.819122:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566214656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819145:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566214656:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118719.819162:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787118719.819182:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214528 00000100:00100000:3.0:1787118719.819185:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214528 00000100:00100000:3.0:1787118719.819206:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214144 00000100:00100000:3.0:1787118719.819208:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214144 00000100:00100000:3.0:1787118719.819216:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214272 00000100:00100000:3.0:1787118719.819218:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214272 00000100:00100000:3.0:1787118719.819229:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787118719.819234:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566214528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819260:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566214528:12345-0@lo:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118719.819265:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787118719.819274:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787118719.819279:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566214144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819299:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566214144:12345-0@lo:400:kworker.0 Request processed in 20us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118719.819305:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787118719.819314:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787118719.819319:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566214272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819344:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566214272:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118719.819350:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787118719.819366:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118719.819371:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118719.819373:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118719.819429:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566214272:0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819452:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566214144:0@lo:400:kworker.0 00010000:00080000:3.0:1787118719.819464:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350006d80 x1873929566214656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118719.819475:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566214656:0@lo:400:kworker.0 00010000:00080000:3.0:1787118719.819512:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961351522680 x1873929566214400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118719.819521:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566214400:0@lo:400:kworker.0 00000100:00100000:3.0:1787118719.819531:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566214528:0@lo:400:kworker.0 00000100:00100000:0.0:1787118719.822867:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214016 00000100:00100000:0.0:1787118719.822897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214016 00000100:00100000:0.0:1787118719.822979:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787118719.822992:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566214016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118719.823120:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566214016:12345-0@lo:400:kworker.0 Request processed in 132us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118719.823129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787118719.823207:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566214016:0@lo:400:kworker.0 00000001:02000400:1.0:1787118720.071667:0:11479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:51:57 (1787118717) === 00000100:00100000:3.0:1787118720.330997:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566214784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118720.331109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118720.331464:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214784 00000100:00100000:0.0:1787118720.331474:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214784 00000100:00100000:0.0:1787118720.331539:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787118720.331552:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566214784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118720.331611:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118720.331667:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566214784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118720.331675:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787118720.331793:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350005880 x1873929566214784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118720.331816:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566214784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118720.387187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118720.387226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.391279:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155904 00000100:00100000:2.0:1787118720.391298:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155904 00000100:00100000:2.0:1787118720.391424:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:2.0:1787118720.391445:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b9d85e8-2500-4b81-a525-0303ce911299+6:9710:x1873929544155904:12345-192.168.203.10@tcp:700:mkdir.0 00000100:00100000:2.0:1787118720.391571:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4b9d85e8-2500-4b81-a525-0303ce911299+6:9710:x1873929544155904:12345-192.168.203.10@tcp:700:mkdir.0 Request processed in 136us (4342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.391579:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:2.0:1787118720.393207:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544155776 00000100:00100000:2.0:1787118720.393224:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544155776 00000100:00100000:2.0:1787118720.393296:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:2.0:1787118720.393309:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544155776:12345-192.168.203.10@tcp:41:mkdir.0 00000004:00000024:2.0:1787118720.393380:0:7892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118720.393486:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544155776:12345-192.168.203.10@tcp:41:mkdir.0 Request processed in 179us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.393495:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00080000:0.0:1787118720.394199:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118720.401513:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.401575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544156160 00000100:00100000:3.0:1787118720.401587:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544156160 00000100:00100000:3.0:1787118720.401650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118720.401661:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:9710:x1873929544156160:12345-192.168.203.10@tcp:36:mkdir.0 00010000:00010000:3.0:1787118720.401752:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118720.408584:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f8542 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b854 expref: 6 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.408618:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94500) 00010000:00010000:3.0:1787118720.409877:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118720.410222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.410237:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.410247:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.410276:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.410284:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.410291:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118720.417940:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787118720.417960:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.417972:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.417981:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.417989:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.417994:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.418015:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.418034:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:3.0:1787118720.418037:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118720.418042:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.418048:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8661 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787118720.418084:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f150816 reply state 0000000079735072 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118720.418094:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787118720.418199:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:9710:x1873929544156160:12345-192.168.203.10@tcp:36:mkdir.0 Request processed in 16534us (16770us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787118720.418208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:1.0:1787118720.430621:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:3.0:1787118720.431107:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431122:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431131:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431138:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ca00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.431144:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431163:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431185:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961359bc8b00) 00010000:00010000:3.0:1787118720.431188:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118720.431193:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.431200:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8668 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118720.432026:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544156288 00000100:00100000:0.0:1787118720.432044:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544156288 00000100:00100000:0.0:1787118720.432113:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:0.0:1787118720.432124:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:9711:x1873929544156288:12345-192.168.203.10@tcp:101:chmod.0 00010000:00010000:0.0:1787118720.432316:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118720.432348:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f866f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8d9 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432442:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432457:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432470:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118720.432544:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787118720.432548:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118720.432595:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432626:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f866f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d9 expref: 8 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432659:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d9 expref: 7 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.432669:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704300) 00010000:00010000:0.0:1787118720.432672:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118720.432676:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030200, rc 0) 00000100:00100000:0.0:1787118720.432786:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:9711:x1873929544156288:12345-192.168.203.10@tcp:101:chmod.0 Request processed in 663us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118720.432793:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:0.0:1787118720.438117:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.438299:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544156544 00000100:00100000:2.0:1787118720.438312:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544156544 00000100:00100000:2.0:1787118720.438410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:2.0:1787118720.438423:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:9711:x1873929544156544:12345-192.168.203.10@tcp:36:chmod.0 00010000:00010000:2.0:1787118720.438494:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118720.438529:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8676 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d9 expref: 7 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.438549:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704300) 00010000:00010000:2.0:1787118720.438561:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118720.438591:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.438606:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.438637:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118720.441390:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcd403c0 reply state 00000000b21eadc0 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.441414:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787118720.441443:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787118720.441590:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:9711:x1873929544156544:12345-192.168.203.10@tcp:36:chmod.0 Request processed in 3163us (3479us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787118720.441601:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00010000:00010000:1.0:1787118720.444368:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444398:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444406:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444413:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.444418:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444439:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444463:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94100) 00010000:00010000:1.0:1787118720.444466:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787118720.444472:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.444478:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f867d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118720.500459:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.500763:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544156672 00000100:00100000:2.0:1787118720.500777:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544156672 00000100:00100000:2.0:1787118720.500862:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118720.501278:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:9712:x1873929544156672:12345-192.168.203.10@tcp:101:chown.0 00010000:00010000:2.0:1787118720.501315:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118720.501346:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8e0 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.501442:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.501458:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.501471:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118720.501545:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787118720.501562:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118720.501614:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.502168:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e0 expref: 9 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.502193:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e0 expref: 8 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.502203:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94300) 00010000:00010000:2.0:1787118720.502392:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118720.502397:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:3.0:1787118720.502594:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:9712:x1873929544156672:12345-192.168.203.10@tcp:101:chown.0 Request processed in 1719us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118720.502603:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:0.0:1787118720.514324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.514425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544156800 00000100:00100000:2.0:1787118720.514438:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544156800 00000100:00100000:2.0:1787118720.514521:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118720.514534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:9712:x1873929544156800:12345-192.168.203.10@tcp:101:chown.0 00010000:00010000:2.0:1787118720.514563:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118720.514591:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8e7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514685:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514700:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514713:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514777:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514792:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514929:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.514945:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118720.514993:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787118720.514997:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118720.515024:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515039:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515046:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515053:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515070:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118720.515075:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515083:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515098:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94300) 00010000:00010000:2.0:1787118720.515101:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118720.515106:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515112:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515127:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515133:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515139:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515144:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118720.515147:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515154:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515169:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96134bc94f00) 00010000:00010000:2.0:1787118720.515172:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118720.515174:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515180:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f86a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515359:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e7 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515404:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e7 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.515413:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96134bc94e00) 00010000:00010000:2.0:1787118720.515415:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118720.515418:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118720.515501:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:9712:x1873929544156800:12345-192.168.203.10@tcp:101:chown.0 Request processed in 970us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.515510:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118720.518798:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118720.518894:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157056 00000100:00100000:0.0:1787118720.518906:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157056 00000100:00100000:0.0:1787118720.518977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:0.0:1787118720.518991:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:9712:x1873929544157056:12345-192.168.203.10@tcp:36:chown.0 00010000:00010000:0.0:1787118720.519062:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118720.519097:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f86a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e7 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.519120:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96134bc94e00) 00010000:00010000:0.0:1787118720.519133:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118720.519166:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.519180:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.519207:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118720.600283:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787118720.602192:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2f14dd7 reply state 00000000bd1db3f8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.602216:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787118720.602475:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787118720.602616:0:5841:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787118720.602700:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:9712:x1873929544157056:12345-192.168.203.10@tcp:36:chown.0 Request processed in 83707us (83910us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787118720.602719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00010000:00010000:3.0:1787118720.607535:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607560:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607568:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607576:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.607582:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607592:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607639:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961351704000) 00010000:00010000:3.0:1787118720.607643:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787118720.607649:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.607656:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.626832:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118720.627231:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157184 00000100:00100000:0.0:1787118720.627245:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157184 00000100:00100000:0.0:1787118720.627327:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:0.0:1787118720.627338:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:9713:x1873929544157184:12345-192.168.203.10@tcp:101:touch.500 00010000:00010000:0.0:1787118720.627381:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118720.627408:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787118720.638074:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 10598us 00010000:00010000:3.0:1787118720.683112:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683141:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683154:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683172:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683178:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683184:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683782:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683794:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.683815:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118720.683982:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787118720.683987:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118720.684093:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684109:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684116:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684124:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684131:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ca00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.684135:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684143:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684158:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94300) 00010000:00010000:3.0:1787118720.684160:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118720.684165:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f86bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684198:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684204:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684210:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684217:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.684220:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684226:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684233:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961359bc8b00) 00010000:00010000:3.0:1787118720.684235:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118720.684238:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684243:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684291:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f86b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8ee expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684308:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8ee expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.684326:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:3.0:1787118720.684328:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787118720.684331:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c000, rc 0) 00000100:00100000:3.0:1787118720.684443:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:9713:x1873929544157184:12345-192.168.203.10@tcp:101:touch.500 Request processed in 57105us (57624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118720.684453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:1.0:1787118720.692616:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.695629:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157440 00000100:00100000:3.0:1787118720.695647:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157440 00000100:00100000:3.0:1787118720.695816:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:3.0:1787118720.695827:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:9713:x1873929544157440:12345-192.168.203.10@tcp:101:touch.500 00010000:00010000:3.0:1787118720.695851:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118720.698035:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d200/0xaa534e3c784f86d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8f5 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698500:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698519:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698531:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698549:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698556:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.698577:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787118720.701776:0:7892:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787118720.702421:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175a00/0xaa534e3c784f86e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.702991:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382175a00/0xaa534e3c784f86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703007:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382175a00/0xaa534e3c784f86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703064:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703072:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703080:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703087:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118720.703092:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703101:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703116:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:3.0:1787118720.703119:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118720.703137:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703143:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f86d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787118720.703162:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006345d28f reply state 000000008d562d96 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118720.703172:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787118720.703219:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d200/0xaa534e3c784f86d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8f5 expref: 10 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703234:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175a00/0xaa534e3c784f86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8f5 expref: 9 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.703242:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff961359bc8800) 00010000:00010000:3.0:1787118720.703244:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118720.703246:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382175a00, rc 0) 00000100:00100000:3.0:1787118720.704028:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+10:9713:x1873929544157440:12345-192.168.203.10@tcp:101:touch.500 Request processed in 8198us (11423us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787118720.704041:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:3.0:1787118720.715276:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:1.0:1787118720.715338:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715353:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715362:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715369:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382175c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.715383:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715391:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715411:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff961359bc8600) 00010000:00010000:1.0:1787118720.715431:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.715437:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.715442:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382175c00/0xaa534e3c784f86df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.715627:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157696 00000100:00100000:2.0:1787118720.715639:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157696 00000100:00100000:2.0:1787118720.715747:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:2.0:1787118720.715759:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:9713:x1873929544157696:12345-192.168.203.10@tcp:36:touch.500 00010000:00010000:2.0:1787118720.715834:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118720.715857:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382175a00/0xaa534e3c784f86e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8f5 expref: 9 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.715868:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff961359bc8800) 00010000:00010000:2.0:1787118720.715886:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118720.715944:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.715961:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.715972:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118720.716142:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088faf9a0 reply state 00000000b096b052 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.716151:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118720.721768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+10:9713:x1873929544157696:12345-192.168.203.10@tcp:36:touch.500 Request processed in 5992us (6486us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787118720.721785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:3.0:1787118720.729191:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.729230:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157824 00000100:00100000:3.0:1787118720.729241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157824 00000100:00100000:3.0:1787118720.729300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:3.0:1787118720.729311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+10:9713:x1873929544157824:12345-192.168.203.10@tcp:101:touch.500 00010000:00010000:3.0:1787118720.729340:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118720.729394:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b8fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.729475:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8fc expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.729491:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8fc expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.729512:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:3.0:1787118720.729515:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787118720.729519:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d400, rc 0) 00000100:00100000:3.0:1787118720.729576:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+11:9713:x1873929544157824:12345-192.168.203.10@tcp:101:touch.500 Request processed in 267us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118720.729583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00010000:00010000:1.0:1787118720.736066:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736090:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736099:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736106:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.736112:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736121:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736142:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118720.736146:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.736151:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.736157:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f86f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118720.744011:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.748294:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544157952 00000100:00100000:3.0:1787118720.748315:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544157952 00000100:00100000:3.0:1787118720.748455:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:3.0:1787118720.748465:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544157952:12345-192.168.203.10@tcp:8:touch.500 00010000:00080000:3.0:1787118720.748504:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1787118720.748550:0:6703:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f8702 00002000:00100000:3.0:1787118720.748565:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b9d85e8-2500-4b81-a525-0303ce911299/ffff96136eb54800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787118720.748595:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787118720.750126:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787118720.750179:0:6703:0:(import.c:65:import_set_state_nolock()) ffff9612423d1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118720.750344:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544157952:12345-192.168.203.10@tcp:8:touch.500 Request processed in 1877us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118720.750365:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:2.0:1787118720.761300:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.764596:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544158080 00000100:00100000:3.0:1787118720.764615:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544158080 00000100:00100000:2.0:1787118720.765163:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:2.0:1787118720.765186:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:0:x1873929544158080:12345-192.168.203.10@tcp:2:touch.500 00000100:00080000:0.0:1787118720.772320:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787118720.780095:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787118720.829389:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787118720.829421:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000100:00100000:0.0:1787118720.829648:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:0:x1873929544158080:12345-192.168.203.10@tcp:2:touch.500 Request processed in 64468us (68356us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787118720.829660:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:1.0:1787118720.841407:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118720.842070:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566214912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118720.842129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118720.842318:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566214912 00000100:00100000:2.0:1787118720.842327:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566214912 00000100:00100000:2.0:1787118720.842399:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787118720.842409:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566214912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118720.842437:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118720.842486:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566214912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.842493:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787118720.842530:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa64000 x1873929566214912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118720.842547:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566214912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118720.843636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544158336 00000100:00100000:3.0:1787118720.843644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544158336 00000100:00100000:3.0:1787118720.843711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:3.0:1787118720.843736:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+10:9713:x1873929544158336:12345-192.168.203.10@tcp:35:touch.500 00000100:00100000:3.0:1787118720.844123:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+11:9713:x1873929544158336:12345-192.168.203.10@tcp:35:touch.500 Request processed in 403us (2725us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787118720.844130:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:1.0:1787118720.867538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.867621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544158464 00000100:00100000:3.0:1787118720.867642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544158464 00000100:00100000:3.0:1787118720.867700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:3.0:1787118720.867710:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+11:9714:x1873929544158464:12345-192.168.203.10@tcp:101:rm.0 00010000:00010000:3.0:1787118720.867764:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118720.867783:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d200/0xaa534e3c784f8709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868136:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868150:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868165:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118720.868244:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787118720.868248:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118720.868292:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d200/0xaa534e3c784f8709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b903 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868342:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b903 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.868350:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:3.0:1787118720.868353:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787118720.868356:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118720.868468:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+12:9714:x1873929544158464:12345-192.168.203.10@tcp:101:rm.0 Request processed in 759us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118720.868475:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:1.0:1787118720.874662:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.874779:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544158720 00000100:00100000:3.0:1787118720.874788:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544158720 00000100:00100000:3.0:1787118720.874857:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:3.0:1787118720.874870:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+12:9714:x1873929544158720:12345-192.168.203.10@tcp:101:rm.0 00010000:00010000:3.0:1787118720.874889:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118720.874909:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b90a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118720.875015:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787118720.875173:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8717 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b90a expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.875194:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94300) 00010000:00010000:3.0:1787118720.875197:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118720.875203:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ca00/0xaa534e3c784f8717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b90a expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118720.875217:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ca00, rc 0) 00000100:00100000:3.0:1787118720.875284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:9714:x1873929544158720:12345-192.168.203.10@tcp:101:rm.0 Request processed in 416us (633us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787118720.875291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:2.0:1787118720.880322:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.880469:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544158848 00000100:00100000:3.0:1787118720.880480:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544158848 00000100:00100000:3.0:1787118720.880537:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:3.0:1787118720.880548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:9714:x1873929544158848:12345-192.168.203.10@tcp:37:rm.0 00000100:00100000:2.0:1787118720.887657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:9714:x1873929544158848:12345-192.168.203.10@tcp:37:rm.0 Request processed in 7099us (7344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.887672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:1.0:1787118720.892011:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.892110:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544159104 00000100:00100000:2.0:1787118720.892119:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544159104 00000100:00100000:2.0:1787118720.892214:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:2.0:1787118720.892225:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:9714:x1873929544159104:12345-192.168.203.10@tcp:35:rm.0 00000100:00100000:2.0:1787118720.892597:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:9714:x1873929544159104:12345-192.168.203.10@tcp:35:rm.0 Request processed in 373us (594us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787118720.892606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:3.0:1787118720.895800:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118720.895937:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544159360 00000100:00100000:1.0:1787118720.895946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544159360 00000100:00100000:1.0:1787118720.895998:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:1.0:1787118720.896008:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:9714:x1873929544159360:12345-192.168.203.10@tcp:101:rm.0 00010000:00010000:1.0:1787118720.896031:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118720.896049:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b911 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.896165:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f872c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.896178:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f872c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.896188:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f872c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118720.896198:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787118720.896318:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b911 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.896336:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f872c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b911 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.896362:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:1.0:1787118720.896365:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787118720.896382:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8c00, rc 0) 00000100:00100000:1.0:1787118720.896446:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544159360:12345-192.168.203.10@tcp:101:rm.0 Request processed in 439us (655us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787118720.896453:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:3.0:1787118720.907283:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.908017:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544159488 00000100:00100000:2.0:1787118720.908028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544159488 00000100:00100000:2.0:1787118720.908100:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:2.0:1787118720.908111:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544159488:12345-192.168.203.10@tcp:41:rm.0 00000004:00000024:2.0:1787118720.908168:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787118720.908241:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544159488:12345-192.168.203.10@tcp:41:rm.0 Request processed in 132us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118720.908249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:0.0:1787118720.915649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118720.916103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544159616 00000100:00100000:1.0:1787118720.916113:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544159616 00000100:00100000:1.0:1787118720.916175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:1.0:1787118720.916185:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544159616:12345-192.168.203.10@tcp:101:rm.0 00010000:00010000:1.0:1787118720.916206:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118720.916226:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f873a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b918 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916303:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916314:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916328:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916360:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916489:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916508:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916516:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118720.916542:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787118720.916547:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118720.916563:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916575:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916583:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916589:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916596:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916602:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.916606:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916622:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916634:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:1.0:1787118720.916637:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.916642:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916648:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916661:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916666:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916671:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916676:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.916678:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916683:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916690:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff96136106b500) 00010000:00010000:1.0:1787118720.916692:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.916695:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916710:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916788:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f873a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b918 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916801:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b918 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.916809:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118720.916812:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118720.916814:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8800, rc 0) 00000100:00100000:1.0:1787118720.917065:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+17:9714:x1873929544159616:12345-192.168.203.10@tcp:101:rm.0 Request processed in 880us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118720.917073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:1.0:1787118720.922703:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118720.923438:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544159872 00000100:00100000:2.0:1787118720.923449:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544159872 00000100:00100000:2.0:1787118720.923515:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:2.0:1787118720.923526:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+17:9714:x1873929544159872:12345-192.168.203.10@tcp:36:rm.0 00010000:00010000:2.0:1787118720.923576:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787118720.923601:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f874f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b918 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.923819:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f86fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8fc expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.923831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118720.923858:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b903 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.923868:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:2.0:1787118720.923871:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118720.923891:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924046:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924063:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924070:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924076:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924268:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924277:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.924284:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118720.925512:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787118720.925524:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300082801741ns, next at 301082798836ns, rc = 0 00010000:00010000:2.0:1787118720.925593:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926123:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926149:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926157:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926233:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926242:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926310:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118720.926332:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926340:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926346:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926352:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118720.926356:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926364:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926387:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118720.926391:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787118720.926403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8764 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926440:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926447:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926453:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926457:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118720.926460:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926465:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926473:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:2.0:1787118720.926476:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118720.926479:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.926484:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8756 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118720.926495:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067bb7823 reply state 0000000038e35a64 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118720.926514:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118720.926616:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544159872:12345-192.168.203.10@tcp:36:rm.0 Request processed in 3081us (3912us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787118720.926625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 30 00010000:00010000:1.0:1787118720.929119:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929135:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929143:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929151:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.929157:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929195:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929212:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff96134bc94100) 00010000:00010000:1.0:1787118720.929215:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.929219:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.929226:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f875d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934263:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118720.934279:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934290:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118720.934294:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934325:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934342:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96134bc94000) 00010000:00010000:0.0:1787118720.934345:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787118720.934349:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934355:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f876b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118720.934391:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118720.934394:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118720.934396:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118720.939156:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118720.940885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160128 00000100:00100000:3.0:1787118720.940897:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160128 00000100:00100000:3.0:1787118720.940967:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:3.0:1787118720.940978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:9714:x1873929544160128:12345-192.168.203.10@tcp:35:rm.0 00000100:00100000:3.0:1787118720.941266:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544160128:12345-192.168.203.10@tcp:35:rm.0 Request processed in 289us (2119us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787118720.941274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:0.0:1787118720.956910:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118720.961606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160384 00000100:00100000:1.0:1787118720.961623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160384 00000100:00100000:1.0:1787118720.961703:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:1.0:1787118720.961713:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+16:9714:x1873929544160384:12345-192.168.203.10@tcp:36:rm.0 00010000:00010000:1.0:1787118720.961819:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787118720.961857:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f872c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b911 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961879:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f86ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8ee expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961891:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff961359bc8200) 00010000:00010000:1.0:1787118720.961907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f868b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8e0 expref: 14 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961917:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96134bc94300) 00010000:00010000:1.0:1787118720.961940:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118720.961961:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961973:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961983:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.961994:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.962000:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.962006:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.962308:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.962317:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.962325:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118720.963132:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787118720.963151:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963159:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963173:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963179:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.963183:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963190:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963200:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96136106b400) 00010000:00010000:1.0:1787118720.963202:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787118720.963205:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8780 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963232:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963239:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963245:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963250:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118720.963253:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963270:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963278:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118720.963280:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118720.963283:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118720.963288:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8772 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118720.963299:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000171268fe reply state 000000008d9ab698 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118720.963307:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787118720.966185:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966200:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966206:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966213:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118720.966218:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966225:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966240:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96136106b100) 00010000:00010000:2.0:1787118720.966243:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118720.966247:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118720.966252:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8779 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118720.967525:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+15:9714:x1873929544160384:12345-192.168.203.10@tcp:36:rm.0 Request processed in 1687us (6496us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787118720.967546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 31 00010000:00010000:3.0:1787118721.801895:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118722.826110:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118723.802781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118723.802823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160512 00000100:00100000:3.0:1787118723.802844:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160512 00000100:00100000:3.0:1787118723.802892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 254 00000100:00100000:3.0:1787118723.802902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544160512:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118723.802967:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544160512:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118723.802974:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 254 00000100:00100000:3.0:1787118723.805266:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118723.806154:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160640 00000100:00100000:1.0:1787118723.806162:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160640 00000100:00100000:1.0:1787118723.806277:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00100000:1.0:1787118723.806288:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544160640:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118723.806373:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544160640:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 87us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118723.806381:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00080000:3.0:1787118723.806456:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118723.820524:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118723.820559:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118723.820587:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160896 00000100:00100000:3.0:1787118723.820595:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160896 00000100:00100000:3.0:1787118723.820655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118723.820665:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544160896:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118723.821880:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544160896:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 1211us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118723.821891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118723.821923:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544160768 00000100:00100000:3.0:1787118723.821928:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544160768 00000100:00100000:3.0:1787118723.821972:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:3.0:1787118723.821981:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544160768:12345-192.168.203.10@tcp:400:kworker.0 00000100:00080000:2.0:1787118723.822105:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118723.822111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118723.822882:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544160768:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 897us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118723.822892:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 61 00010000:00010000:3.0:1787118723.849925:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118724.874003:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118724.938428:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566215424:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.938519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118724.938594:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787118724.938601:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566215040:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.938628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118724.938655:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566215552:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.938680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118724.938709:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566215168:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.938764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118724.938779:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566215680:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.938799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118724.939023:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215424 00000100:00100000:2.0:1787118724.939031:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215424 00000100:00100000:2.0:1787118724.939095:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215680 00000100:00100000:2.0:1787118724.939099:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215680 00000100:00100000:2.0:1787118724.939124:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787118724.939138:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566215424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939194:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566215424:12345-0@lo:400:kworker.0 Request processed in 62us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939201:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787118724.939215:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787118724.939223:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566215680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939249:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566215680:12345-0@lo:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939255:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787118724.939271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787118724.939275:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118724.939300:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215552 00000100:00100000:2.0:1787118724.939304:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215552 00000100:00100000:2.0:1787118724.939329:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215168 00000100:00100000:2.0:1787118724.939332:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215168 00000100:00100000:2.0:1787118724.939363:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787118724.939371:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566215552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939402:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566215552:12345-0@lo:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939408:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787118724.939418:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787118724.939424:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566215168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939467:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566215168:12345-0@lo:400:kworker.0 Request processed in 43us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939483:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787118724.939502:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215040 00000100:00100000:2.0:1787118724.939506:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215040 00000100:00100000:2.0:1787118724.939530:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787118724.939537:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566215040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939567:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613501aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566215040:12345-0@lo:400:kworker.0 Request processed in 31us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787118724.939600:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566215296:0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787118724.939649:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118724.939655:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215296 00000100:00100000:2.0:1787118724.939658:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215296 00000100:00100000:2.0:1787118724.939681:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787118724.939687:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566215296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.939717:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566215296:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118724.939739:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1787118724.939751:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118724.939773:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566215296:0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.940231:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566215040:0@lo:400:kworker.0 00010000:00080000:3.0:1787118724.951376:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137abb4380 x1873929566215680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118724.951394:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566215680:0@lo:400:kworker.0 00000100:00100000:3.0:1787118724.951430:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566215168:0@lo:400:kworker.0 00000100:00100000:2.0:1787118724.957273:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566215552:0@lo:400:kworker.0 00010000:00080000:2.0:1787118724.957299:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137f726d80 x1873929566215424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118724.957353:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566215424:0@lo:400:kworker.0 00000100:00100000:3.0:1787118725.455503:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566215808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118725.455572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118725.455759:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215808 00000100:00100000:0.0:1787118725.455768:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215808 00000100:00100000:0.0:1787118725.455826:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787118725.455836:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566215808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118725.455874:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118725.455929:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566215808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118725.455936:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787118725.456038:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350007100 x1873929566215808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118725.456057:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566215808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118725.898118:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787118725.962567:0:7006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305119841833ns, next at 306119838909ns, rc = 0 00000100:00100000:1.0:1787118725.962601:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566215936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118725.962677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118725.962769:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566215936 00000100:00100000:1.0:1787118725.962777:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566215936 00000100:00100000:1.0:1787118725.962836:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787118725.962846:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566215936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118725.962879:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118725.962922:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566215936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118725.962930:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787118725.962984:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4c700 x1873929566215936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118725.963003:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566215936:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787118726.059344:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787118726.059368:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787118726.059379:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787118726.059516:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566216064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787118726.059582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118726.059655:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216064 00000100:00100000:1.0:1787118726.059662:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216064 00000100:00100000:1.0:1787118726.059746:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787118726.059756:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566216064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787118726.059782:0:8419:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787118726.060830:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a85447f, atime: 0x6a85447f, ctime: 0x6a85447f, blocks: 0x1 00010000:00010000:1.0:1787118726.060843:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118726.060878:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1787118726.060882:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118726.060890:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118726.060907:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118726.060916:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118726.060923:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118726.060950:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787118726.061515:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566216064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1758us (1930us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787118726.061525:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787118726.061562:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787118726.061599:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961375c4c700/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787118726.061607:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566216064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787118726.061830:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118726.061837:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118726.061848:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118726.061852:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118726.061862:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118726.061881:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118726.061888:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42c066b/0xaa534e3c784f8787 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118726.061906:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118726.061907:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118726.061909:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787118726.244694:0:11631:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787118726.922961:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787118727.563630:0:11679:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde5463b80 20000000:00000080:0.0:1787118727.563649:0:11679:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961375c15000 uarg=0000000000000000 20000000:01000000:0.0:1787118727.563686:0:11679:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787118727.563692:0:11679:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787118727.563704:0:11679:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787118727.568180:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787118727.568506:0:11679:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787118727.582028:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787118727.582081:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787118727.582135:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787118727.582153:0:11679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787118727.582173:0:11679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582192:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582200:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582208:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582215:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582221:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582228:0:11679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582265:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582278:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 18 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.582305:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216192:0@lo:104: 00000100:00100000:0.0:1787118727.582373:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118727.582439:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582454:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 18 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.582462:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216320:0@lo:104: 00000100:00100000:0.0:1787118727.582481:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118727.582503:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.582511:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.582519:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350004a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216448:0@lo:104: 00000100:00100000:3.0:1787118727.582930:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216192 00000100:00100000:3.0:1787118727.582938:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216192 00000100:00100000:3.0:1787118727.582972:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216320 00000100:00100000:3.0:1787118727.582982:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216320 00000100:00100000:3.0:1787118727.583000:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787118727.583008:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:11679:x1873929566216192:12345-0@lo:104: 00010000:00010000:3.0:1787118727.583019:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583082:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118727.583089:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+4:11679:x1873929566216192:12345-0@lo:104: Request processed in 82us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118727.583095:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787118727.583114:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787118727.583119:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11679:x1873929566216320:12345-0@lo:104: 00010000:00010000:3.0:1787118727.583126:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583160:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787118727.583165:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11679:x1873929566216320:12345-0@lo:104: Request processed in 46us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118727.583170:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787118727.583187:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787118727.583192:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583198:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118727.583202:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583210:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118727.583228:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118727.583234:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787118727.583267:0:8462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583274:0:8462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118727.583293:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583300:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340031400/0xaa534e3c784f8653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f865a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583312:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118727.583315:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583321:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118727.583332:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583338:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118727.583344:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118727.583350:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787118727.583380:0:8462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583386:0:8462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118727.583392:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583398:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340031c00/0xaa534e3c784f8645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f864c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.583407:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118727.583409:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118727.583411:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118727.583422:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566216576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787118727.583451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118727.583487:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118727.583493:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566216704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787118727.583510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118727.583646:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216576 00000100:00100000:2.0:1787118727.583651:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216576 00010000:00010000:2.0:1787118727.583677:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 19 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.583684:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118727.583749:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216704 00000100:00100000:2.0:1787118727.583753:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216704 00010000:00010000:2.0:1787118727.583768:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 20 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118727.583785:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787118727.583854:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3298:x1873929566216576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118727.583865:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118727.583870:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118727.583881:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118727.583984:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787118727.583994:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3298:x1873929566216704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118727.584011:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118727.584016:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 20 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.584269:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118727.584297:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 20 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.584310:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118727.585791:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.585809:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.585823:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350005500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216832:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118727.585895:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.585921:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.585931:0:11679:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216960:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118727.585956:0:11679:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787118727.585978:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8d800/0xaa534e3c784f865a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8653 expref: 20 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.585991:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216192:0@lo:104: 00010000:00010000:0.0:1787118727.586002:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031000/0xaa534e3c784f864c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8645 expref: 19 pid: 5834 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.586010:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216320:0@lo:104: 00010000:00010000:2.0:1787118727.587005:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118727.587130:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3298:x1873929566216704:12345-0@lo:103:ldlm_bl.0 Request processed in 3135us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118727.587141:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787118727.587299:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787118727.587313:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566216448 00000100:00100000:3.0:1787118727.587319:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566216448 00000100:00100000:3.0:1787118727.587443:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787118727.587460:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11679:x1873929566216448:12345-0@lo:104: 00010000:00010000:3.0:1787118727.587473:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587520:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118727.587525:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+3:11679:x1873929566216448:12345-0@lo:104: Request processed in 69us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118727.587560:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787118727.587596:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118727.587601:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587609:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118727.587613:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587621:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118727.587629:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118727.587634:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787118727.587663:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587669:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118727.587684:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587692:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c8600/0xaa534e3c784f8637 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f863e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.587706:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118727.587708:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118727.587709:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118727.588193:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566217088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118727.588232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118727.588378:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217088 00000100:00100000:3.0:1787118727.588391:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217088 00010000:00010000:3.0:1787118727.588409:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118727.588452:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787118727.588460:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350045050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3300:x1873929566217088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787118727.588470:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118727.588475:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.588486:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 18 pid: 5836 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.588501:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118727.588672:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350045050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3300:x1873929566217088:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118727.588679:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787118727.588814:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566217088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787118727.591863:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118727.592237:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161024 00000100:00100000:1.0:1787118727.592246:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161024 00000100:00100000:0.0:1787118727.592347:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566216704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118727.592350:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:3298:x1873929566216576:12345-0@lo:103:ldlm_bl.0 Request processed in 8499us (8896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118727.592361:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787118727.592365:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566216576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118727.592412:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8dc00/0xaa534e3c784f863e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f8637 expref: 16 pid: 5836 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.592426:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350004a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216448:0@lo:104: 00010000:00010000:1.0:1787118727.592453:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 13 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118727.592485:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:1.0:1787118727.592494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544161024:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118727.592506:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118727.592512:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 13 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.592522:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 13 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.592558:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118727.592607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544161024:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 114us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118727.592614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:0.0:1787118727.593992:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350005500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216832:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118727.594006:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f8629 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8cb expref: 12 pid: 5834 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118727.594017:0:11679:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1873929566216960:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118727.594049:0:11679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118727.596082:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118727.596162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161152 00000100:00100000:1.0:1787118727.596170:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161152 00010000:00010000:1.0:1787118727.596203:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118727.596241:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:1.0:1787118727.596250:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+12:2368:x1873929544161152:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118727.596263:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118727.596269:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596280:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596310:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8c600/0xaa534e3c784f8630 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b8d2 expref: 12 pid: 5835 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596335:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596343:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596359:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596379:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596386:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596392:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596398:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118727.596402:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596410:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596437:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118727.596454:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118727.596505:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+11:2368:x1873929544161152:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 255us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118727.596513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 34 00010000:00010000:0.0:1787118727.596867:0:11679:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.596876:0:11679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118727.596883:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030800/0xaa534e3c784f878e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118727.946815:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118728.920878:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118728.921113:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161280 00000100:00100000:0.0:1787118728.921122:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161280 00000100:00100000:0.0:1787118728.921181:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 256 00000100:00100000:0.0:1787118728.921191:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:2368:x1873929544161280:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118728.921260:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+11:2368:x1873929544161280:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 70us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118728.921275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 256 00000100:00100000:3.0:1787118728.921394:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118728.921501:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118728.921524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118728.922276:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161408 00000100:00100000:1.0:1787118728.922284:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161408 00000100:00100000:1.0:1787118728.922352:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161664 00000100:00100000:1.0:1787118728.922356:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161664 00000100:00100000:1.0:1787118728.922380:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 111 00000100:00100000:1.0:1787118728.922388:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544161408:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118728.922451:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544161408:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 64us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118728.922459:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 111 00000100:00100000:1.0:1787118728.922473:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00100000:1.0:1787118728.922480:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544161664:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118728.922504:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544161664:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118728.922510:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00080000:2.0:1787118728.922709:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118728.924471:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161536 00000100:00100000:0.0:1787118728.924482:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161536 00000100:00100000:0.0:1787118728.924573:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:0.0:1787118728.924583:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544161536:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118728.924651:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544161536:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 69us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118728.924659:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00080000:2.0:1787118728.924873:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787118728.969932:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787118729.097835:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787118729.097844:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137a707800 from 7 10000000:01000000:3.0:1787118729.097849:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787118729.097897:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.097927:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.097939:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118729.097964:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.098045:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118729.098116:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961345553300 going to sleep for 11 seconds 00000100:00100000:1.0:1787118729.098130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217216 00000100:00100000:1.0:1787118729.098139:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217216 00000100:00100000:1.0:1787118729.098187:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787118729.098196:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:5838:x1873929566217216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118729.098209:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118729.098221:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f879c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f8795 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118729.098244:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f8795 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118729.098255:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f879c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f8795 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118729.098264:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8600, rc 0) 00000100:00100000:1.0:1787118729.098323:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118729.098330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787118729.098424:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118729.098438:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.098448:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118729.098502:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.098527:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118729.098604:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961345553300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.102915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217344 00000100:00100000:2.0:1787118729.102930:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217344 00000100:00100000:2.0:1787118729.103129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787118729.103141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.103548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 409us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.103557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787118729.103654:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.103712:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.103788:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118729.104611:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961345553300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118729.104925:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217472 00000100:00100000:0.0:1787118729.104932:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217472 00000100:00100000:0.0:1787118729.104970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787118729.104978:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118729.108805:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3820us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118729.108820:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787118729.109038:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.115786:0:11693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11693:1873929566217600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118729.115884:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118729.115930:0:11693:0:(client.c:2702:ptlrpc_set_wait()) set ffff961345553900 going to sleep for 11 seconds 00000100:00100000:0.0:1787118729.116054:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217600 00000100:00100000:0.0:1787118729.116061:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217600 00000100:00100000:0.0:1787118729.116111:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787118729.116120:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:11693:x1873929566217600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118729.116350:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:11693:x1873929566217600:12345-0@lo:502:llog_process_th.0 Request processed in 223us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118729.116359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787118729.117395:0:11693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11693:1873929566217600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118729.117435:0:11693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118729.117446:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118729.117448:0:11693:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787118729.117454:0:11693:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96137a707800 00000020:00000080:3.0:1787118729.117457:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787118729.117556:0:11693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11693:1873929566217728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118729.117605:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118729.117645:0:11693:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118729.117878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217728 00000100:00100000:1.0:1787118729.117884:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217728 00000100:00100000:1.0:1787118729.117935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787118729.117944:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:11693:x1873929566217728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118729.118154:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:11693:x1873929566217728:12345-0@lo:502:llog_process_th.0 Request processed in 210us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118729.118162:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787118729.118368:0:11693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11693:1873929566217728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118729.118389:0:11693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118729.118395:0:11693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118729.118397:0:11693:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787118729.118401:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:1.0:1787118729.123186:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118729.123266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161792 00000100:00100000:3.0:1787118729.123275:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161792 00000100:00100000:3.0:1787118729.123337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 262 00000100:00100000:3.0:1787118729.123356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+11:5611:x1873929544161792:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118729.123372:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118729.123388:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d200/0xaa534e3c784f87a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b91f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.123419:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d200/0xaa534e3c784f87a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b91f expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.123440:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d200/0xaa534e3c784f87a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b91f expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118729.123460:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d200, rc 0) 00000100:00100000:3.0:1787118729.123521:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544161792:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 166us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.123529:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 262 00000020:01000000:2.0:1787118729.129454:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787118729.129498:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787118729.129510:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.129524:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118729.129535:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787118729.129538:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375697800 from 7 10000000:01000000:2.0:1787118729.129540:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787118729.129579:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.129588:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.129599:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118729.129624:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.129697:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.129765:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118729.130635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217856 00000100:00100000:0.0:1787118729.130645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217856 00000100:00100000:0.0:1787118729.130711:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787118729.130738:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+17:5838:x1873929566217856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118729.130752:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118729.130766:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961340031000/0xaa534e3c784f87b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f87aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.130790:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961340031000/0xaa534e3c784f87b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f87aa expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.130801:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961340031000/0xaa534e3c784f87b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f87aa expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.130810:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031000, rc 0) 00000100:00100000:0.0:1787118729.130861:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566217856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118729.130884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787118729.133112:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118729.133138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.133151:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118729.133243:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.133296:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.133357:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.133377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566217984 00000100:00100000:2.0:1787118729.133381:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566217984 00000100:00100000:2.0:1787118729.133426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787118729.133435:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566217984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.133703:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566217984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.133710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787118729.133776:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.133804:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.133842:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.133858:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.133872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218112 00000100:00100000:2.0:1787118729.133875:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218112 00000100:00100000:2.0:1787118729.133899:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787118729.133906:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566218112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.134041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566218112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.134048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787118729.134084:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.139673:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11695:1873929566218240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.139806:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.139849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218240 00000100:00100000:2.0:1787118729.139856:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218240 00000100:00100000:2.0:1787118729.139898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787118729.139908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:11695:x1873929566218240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.141419:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135008bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:11695:x1873929566218240:12345-0@lo:502:llog_process_th.0 Request processed in 1111us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.141440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787118729.141580:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.141604:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11695:1873929566218240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118729.141637:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118729.141646:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118729.141653:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787118729.141661:0:11695:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff961375697800 00000020:00000080:2.0:1787118729.141789:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787118729.142460:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11695:1873929566218368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.142593:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.142634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218368 00000100:00100000:2.0:1787118729.142638:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218368 00000100:00100000:2.0:1787118729.142691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787118729.142702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:11695:x1873929566218368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.142900:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:11695:x1873929566218368:12345-0@lo:502:llog_process_th.0 Request processed in 201us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.142908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787118729.142943:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.142958:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11695:1873929566218368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118729.142985:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118729.142991:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118729.142993:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787118729.142997:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:2.0:1787118729.144569:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118729.147105:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544161920 00000100:00100000:3.0:1787118729.147117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544161920 00000100:00100000:3.0:1787118729.147176:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 268 00000100:00100000:3.0:1787118729.147185:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544161920:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.147650:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544161920:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 464us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.147659:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 268 00000020:01000000:0.0:1787118729.149643:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787118729.149831:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118729.149844:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.149856:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118729.149867:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787118729.149870:0:5838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961347c3c800 from 7 10000000:01000000:0.0:1787118729.149873:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118729.149909:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.149917:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118729.149927:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118729.149951:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787118729.150011:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118729.150159:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787118729.151795:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118729.167367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218496 00000100:00100000:2.0:1787118729.167381:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218496 00000100:00100000:2.0:1787118729.167567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162048 00000100:00100000:2.0:1787118729.167571:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162048 00000100:00100000:2.0:1787118729.167594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787118729.167604:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:5838:x1873929566218496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118729.167621:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118729.167639:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986c00/0xaa534e3c784f87bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f87b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.167679:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986c00/0xaa534e3c784f87bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f87b8 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.167692:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986c00/0xaa534e3c784f87bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f87b8 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.167701:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986c00, rc 0) 00000100:00100000:2.0:1787118729.167788:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566218496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (17777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.167795:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787118729.168135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 270 00000100:00100000:2.0:1787118729.168145:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544162048:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.168337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544162048:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 192us (16547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.168350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 270 00000100:00100000:2.0:1787118729.168405:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118729.168423:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.168441:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118729.168569:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.168602:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.168632:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.169308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218624 00000100:00100000:2.0:1787118729.169325:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218624 00000100:00100000:2.0:1787118729.169353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787118729.169360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566218624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.170271:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566218624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 907us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.170281:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787118729.170340:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.170377:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.170411:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.170427:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787118729.171116:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218752 00000100:00100000:2.0:1787118729.171121:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218752 00000100:00100000:2.0:1787118729.171150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787118729.171164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566218752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.171310:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:5838:x1873929566218752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.171328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787118729.171376:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:5838:1873929566218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118729.176128:0:11697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11697:1873929566218880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.176215:0:11697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.176272:0:11697:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118729.176693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566218880 00000100:00100000:1.0:1787118729.176701:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566218880 00000100:00100000:1.0:1787118729.176767:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787118729.176776:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:11697:x1873929566218880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118729.177016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:11697:x1873929566218880:12345-0@lo:502:llog_process_th.0 Request processed in 240us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118729.177024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787118729.177450:0:11697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11697:1873929566218880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118729.178573:0:11697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118729.178587:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118729.178590:0:11697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787118729.178597:0:11697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff961347c3c800 00000020:00000080:2.0:1787118729.178600:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787118729.179640:0:11697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11697:1873929566219008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118729.180628:0:11697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118729.181367:0:11697:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118729.181890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219008 00000100:00100000:1.0:1787118729.181899:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219008 00000100:00100000:1.0:1787118729.181948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787118729.181957:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:11697:x1873929566219008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118729.183256:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:11697:x1873929566219008:12345-0@lo:502:llog_process_th.0 Request processed in 1295us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118729.183268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787118729.183449:0:11697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:11697:1873929566219008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118729.183550:0:11697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118729.183559:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118729.183561:0:11697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787118729.183566:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787118729.183626:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787118729.183643:0:5838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787118729.183652:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.183922:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787118729.184388:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787118729.203928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118729.204288:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162176 00000100:00100000:3.0:1787118729.204299:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162176 00000100:00100000:3.0:1787118729.204365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 275 00000100:00100000:3.0:1787118729.204376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:9986:x1873929544162176:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118729.205279:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+12:9986:x1873929544162176:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 902us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.205290:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 275 00000100:00100000:0.0:1787118729.211202:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118729.215484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162304 00000100:00100000:1.0:1787118729.215498:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162304 00000100:00100000:1.0:1787118729.215562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 276 00000100:00100000:1.0:1787118729.215572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:9986:x1873929544162304:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787118729.215872:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+12:9986:x1873929544162304:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 300us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118729.215880:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 276 00000100:00100000:1.0:1787118729.233092:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118729.233185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162432 00000100:00100000:2.0:1787118729.233195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162432 00000100:00100000:2.0:1787118729.233254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 277 00000100:00100000:2.0:1787118729.233265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+12:5611:x1873929544162432:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118729.233282:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118729.233298:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986600/0xaa534e3c784f87c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b926 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.233336:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986600/0xaa534e3c784f87c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b926 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.233346:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986600/0xaa534e3c784f87c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b926 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118729.233356:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986600, rc 0) 00000100:00100000:2.0:1787118729.233415:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544162432:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.233421:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 277 00000100:00100000:2.0:1787118729.241309:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118729.241384:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162560 00000100:00100000:3.0:1787118729.241394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162560 00000100:00100000:3.0:1787118729.241447:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 278 00000100:00100000:3.0:1787118729.241457:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544162560:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.242310:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544162560:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 851us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.242330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 278 00000100:00100000:3.0:1787118729.259569:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118729.259705:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162688 00000100:00100000:0.0:1787118729.259715:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162688 00000100:00100000:3.0:1787118729.259907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 279 00000100:00100000:3.0:1787118729.259920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544162688:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118729.260128:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:5611:x1873929544162688:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 210us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.260136:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 279 00000100:00100000:1.0:1787118729.271176:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118729.271283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162816 00000100:00100000:2.0:1787118729.271292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162816 00000100:00100000:2.0:1787118729.271422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 280 00000100:00100000:2.0:1787118729.271434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:9989:x1873929544162816:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787118729.271698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:9989:x1873929544162816:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 266us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118729.271707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 280 00000100:00100000:2.0:1787118729.280930:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118729.280990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544162944 00000100:00100000:3.0:1787118729.281001:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544162944 00000100:00100000:3.0:1787118729.281057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 281 00000100:00100000:3.0:1787118729.281068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:9989:x1873929544162944:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118729.281306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:9989:x1873929544162944:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 239us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118729.281325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 281 00010000:00010000:1.0:1787118729.993941:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118730.058015:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566219392:0@lo:400:kworker.0 00000100:00100000:2.0:1787118730.058015:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566219520:0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.058090:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566219136:0@lo:400:kworker.0 00000100:00100000:0.0:1787118730.058171:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566219264:0@lo:400:kworker.0 00000100:00100000:2.0:1787118730.061674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118730.062237:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219520 00000100:00100000:1.0:1787118730.062247:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219520 00000100:00080000:2.0:1787118730.062301:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118730.062307:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118730.062329:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566219520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.062395:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566219520:12345-0@lo:400:kworker.0 Request processed in 69us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118730.062403:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118730.063018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118730.063046:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566219520:0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.063069:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566219648:0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.063103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118730.063126:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219648 00000100:00100000:1.0:1787118730.063130:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219648 00000100:00100000:1.0:1787118730.063161:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787118730.063169:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566219648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.063202:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566219648:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118730.063209:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787118730.063237:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566219648:0@lo:400:kworker.0 00000100:00100000:2.0:1787118730.063534:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219136 00000100:00100000:2.0:1787118730.063540:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219136 00000100:00100000:2.0:1787118730.063590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787118730.063598:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566219136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118730.063637:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566219136:12345-0@lo:400:kworker.0 Request processed in 40us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118730.063644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1787118730.063833:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118730.065794:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566219136:0@lo:400:kworker.0 00000100:00100000:3.0:1787118730.066670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118730.075888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118730.081524:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566219776:0@lo:400:kworker.0 00000100:00100000:0.0:1787118730.081587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118730.081755:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219776 00000100:00100000:2.0:1787118730.081763:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219776 00000100:00100000:2.0:1787118730.081822:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787118730.081841:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566219776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118730.081890:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566219776:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118730.081897:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787118730.082006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787118730.082032:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613500e8380 x1873929566219776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118730.082046:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566219776:0@lo:400:kworker.0 00000100:00100000:1.0:1787118730.082374:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219392 00000100:00100000:1.0:1787118730.082378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219392 00000100:00080000:0.0:1787118730.082469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118730.083261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219264 00000100:00100000:1.0:1787118730.083267:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219264 00000100:00100000:3.0:1787118730.085006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787118730.085025:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118730.085190:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566219392:12345-0@lo:400:kworker.0 Request processed in 173us (18522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118730.085199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787118730.085233:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787118730.085240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566219264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118730.085282:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566219264:12345-0@lo:400:kworker.0 Request processed in 42us (9399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118730.085288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787118730.085470:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566219264:0@lo:400:kworker.0 00000100:00100000:0.0:1787118730.089881:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566219392:0@lo:400:kworker.0 00000040:00080000:3.0:1787118730.189160:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787118730.570236:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118730.570276:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566219904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118730.570351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118730.570505:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566219904 00000100:00100000:1.0:1787118730.570514:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566219904 00000100:00100000:1.0:1787118730.570564:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787118730.570573:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566219904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118730.570620:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118730.570670:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566219904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118730.570677:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787118730.571114:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350006a00 x1873929566219904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118730.571132:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566219904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118731.018680:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118731.081917:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118731.081938:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566220032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118731.082011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118731.082065:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220032 00000100:00100000:2.0:1787118731.082073:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220032 00000100:00100000:2.0:1787118731.082169:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787118731.082180:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566220032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118731.082212:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118731.082256:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566220032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118731.082262:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787118731.082796:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566220032:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787118731.145848:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787118732.044055:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118733.065908:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118734.043135:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118734.043177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118734.043268:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118734.043313:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118734.043447:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163072 00000100:00100000:0.0:1787118734.043456:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163072 00000100:00100000:0.0:1787118734.043510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 283 00000100:00100000:0.0:1787118734.043519:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544163072:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118734.043595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544163072:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118734.043603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 283 00000100:00100000:1.0:1787118734.047442:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163200 00000100:00100000:1.0:1787118734.047455:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163200 00000100:00100000:1.0:1787118734.047540:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163456 00000100:00100000:1.0:1787118734.047554:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163456 00000100:00100000:1.0:1787118734.047588:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00100000:3.0:1787118734.047599:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:1.0:1787118734.047601:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544163200:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118734.047616:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544163456:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118734.047681:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544163200:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 84us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118734.047689:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00080000:0.0:1787118734.047716:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118734.048378:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163328 00000100:00100000:2.0:1787118734.048384:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163328 00000100:00100000:2.0:1787118734.048442:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:2.0:1787118734.048454:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544163328:12345-192.168.203.10@tcp:400:kworker.0 00000100:00080000:0.0:1787118734.048521:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118734.050912:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544163456:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 3291us (7587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118734.050928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:2.0:1787118734.057012:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544163328:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 8549us (13820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118734.057028:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00010000:00010000:1.0:1787118734.091875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118735.114074:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118735.178101:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566220544:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178325:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787118735.178333:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566220160:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178415:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566220672:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178475:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566220416:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178533:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787118735.178538:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566220288:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178609:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566220800:0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.178632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.178664:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220544 00000100:00100000:1.0:1787118735.178672:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220544 00000100:00100000:0.0:1787118735.178993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220672 00000100:00100000:0.0:1787118735.179004:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220672 00000100:00100000:1.0:1787118735.179129:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220800 00000100:00100000:1.0:1787118735.179135:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220800 00000100:00100000:1.0:1787118735.179167:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787118735.179177:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566220544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118735.179220:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220416 00000100:00100000:0.0:1787118735.179227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220416 00000100:00100000:0.0:1787118735.179255:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220288 00000100:00100000:1.0:1787118735.179257:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566220544:12345-0@lo:400:kworker.0 Request processed in 75us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118735.179261:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220288 00000100:00100000:1.0:1787118735.179285:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787118735.179302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787118735.179314:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787118735.179323:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566220800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118735.179357:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566220800:12345-0@lo:400:kworker.0 Request processed in 36us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118735.179375:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787118735.179451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566220672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118735.179963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787118735.179983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566220416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118735.180069:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566220416:12345-0@lo:400:kworker.0 Request processed in 96us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118735.180094:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787118735.180116:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787118735.180124:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566220288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118735.180158:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566220288:12345-0@lo:400:kworker.0 Request processed in 36us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118735.180166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787118735.180283:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566220672:12345-0@lo:400:kworker.0 Request processed in 963us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118735.180290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787118735.180333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220160 00000100:00100000:0.0:1787118735.180339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220160 00000100:00100000:0.0:1787118735.180368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787118735.180374:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566220160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118735.180404:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566220160:12345-0@lo:400:kworker.0 Request processed in 31us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118735.180411:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1787118735.180436:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118735.180441:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118735.180444:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118735.180813:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566220160:0@lo:400:kworker.0 00000100:00100000:3.0:1787118735.180839:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566220672:0@lo:400:kworker.0 00000100:00100000:3.0:1787118735.180851:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787118735.180859:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961375c4c700, transno 4294967300 00000100:00100000:3.0:1787118735.180872:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566220544:0@lo:400:kworker.0 00000100:00100000:3.0:1787118735.181419:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566220288:0@lo:400:kworker.0 00010000:00080000:3.0:1787118735.181443:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375c4d880 x1873929566220800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118735.181455:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566220800:0@lo:400:kworker.0 00000100:00100000:3.0:1787118735.181466:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566220416:0@lo:400:kworker.0 00000100:00100000:3.0:1787118735.689996:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566220928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118735.690065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118735.692232:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566220928 00000100:00100000:1.0:1787118735.692251:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566220928 00000100:00100000:1.0:1787118735.692409:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787118735.692423:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566220928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118735.692477:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118735.692603:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566220928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118735.692611:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787118735.692706:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350007480 x1873929566220928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118735.692754:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566220928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118736.138013:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118736.211135:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118736.211173:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566221056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118736.211280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118736.211364:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221056 00000100:00100000:2.0:1787118736.211374:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221056 00000100:00100000:2.0:1787118736.211432:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787118736.211441:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566221056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118736.211487:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118736.211537:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566221056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118736.211545:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787118736.213867:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566221056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787118737.162078:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118738.193053:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118739.160215:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118739.160277:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118739.160332:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118739.160392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118739.160903:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163584 00000100:00100000:3.0:1787118739.160915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163584 00000100:00100000:3.0:1787118739.160979:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 285 00000100:00100000:3.0:1787118739.160990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544163584:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118739.161082:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544163584:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 94us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118739.161090:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 285 00000100:00100000:1.0:1787118739.161393:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163712 00000100:00100000:1.0:1787118739.161399:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163712 00000100:00100000:1.0:1787118739.161456:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163968 00000100:00100000:1.0:1787118739.161459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163968 00000100:00100000:1.0:1787118739.161484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:1.0:1787118739.161493:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544163712:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118739.161501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:2.0:1787118739.161525:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544163968:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118739.161538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544163712:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 46us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118739.161546:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:2.0:1787118739.161570:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544163968:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 57us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118739.161570:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544163840 00000100:00100000:1.0:1787118739.161575:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544163840 00000100:00100000:2.0:1787118739.161582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:1.0:1787118739.161613:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:1.0:1787118739.161621:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544163840:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118739.161646:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544163840:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 26us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118739.161652:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00080000:3.0:1787118739.162109:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118739.162116:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118739.210012:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118740.234027:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118740.303364:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566221312:0@lo:400:kworker.0 00000100:00100000:3.0:1787118740.303482:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566221568:0@lo:400:kworker.0 00000100:00100000:1.0:1787118740.303483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118740.303556:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221312 00000100:00100000:2.0:1787118740.303565:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221312 00000100:00100000:0.0:1787118740.303610:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566221184:0@lo:400:kworker.0 00000100:00100000:2.0:1787118740.303668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787118740.303681:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566221312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118740.308798:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566221824:0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.311427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118740.311504:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566221696:0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.311564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118740.311626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221184 00000100:00100000:0.0:1787118740.311636:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221184 00000100:00100000:0.0:1787118740.311693:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787118740.311715:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566221184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.311810:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566221184:12345-0@lo:400:kworker.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118740.311837:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787118740.311896:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566221184:0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.311929:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221696 00000100:00100000:0.0:1787118740.311933:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221696 00000100:00100000:0.0:1787118740.311971:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787118740.311978:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.312497:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566221696:12345-0@lo:400:kworker.0 Request processed in 516us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118740.312505:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787118740.312558:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566221696:0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.312607:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566221440:0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.312639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118740.312674:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221440 00000100:00100000:0.0:1787118740.312678:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221440 00000100:00100000:0.0:1787118740.312717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787118740.312752:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566221440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118740.312867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566221440:12345-0@lo:400:kworker.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118740.312874:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787118740.312898:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566221440:0@lo:400:kworker.0 00000100:00100000:2.0:1787118740.313756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566221312:12345-0@lo:400:kworker.0 Request processed in 10072us (10265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118740.313766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787118740.313815:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118740.321752:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118740.321867:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566221312:0@lo:400:kworker.0 00000100:00100000:3.0:1787118740.321971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118740.322182:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221824 00000100:00100000:2.0:1787118740.322192:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221824 00000100:00100000:2.0:1787118740.322322:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221568 00000100:00100000:2.0:1787118740.322334:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221568 00000100:00080000:3.0:1787118740.322644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118740.322651:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118740.322802:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787118740.322816:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566221824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118740.322902:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566221824:12345-0@lo:400:kworker.0 Request processed in 87us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118740.322910:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787118740.322933:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787118740.322940:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566221568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118740.322981:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566221568:12345-0@lo:400:kworker.0 Request processed in 42us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118740.322987:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787118740.323022:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137aa66680 x1873929566221824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118740.323037:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566221824:0@lo:400:kworker.0 00000100:00100000:3.0:1787118740.325549:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566221568:0@lo:400:kworker.0 00000040:00080000:0.0:1787118740.426859:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787118740.811177:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787118740.811208:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566221952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118740.811338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118740.811610:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566221952 00000100:00100000:3.0:1787118740.811621:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566221952 00000100:00100000:3.0:1787118740.811686:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787118740.811697:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566221952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118740.811775:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118740.811834:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566221952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118740.811842:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787118740.811988:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961350007100 x1873929566221952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118740.812009:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566221952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118741.257955:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118741.322069:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118741.322107:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566222080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118741.322210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118741.322752:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222080 00000100:00100000:2.0:1787118741.322763:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222080 00000100:00100000:2.0:1787118741.322816:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787118741.322825:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566222080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118741.322857:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118741.322936:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566222080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118741.322953:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787118741.322990:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566222080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118742.287555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118743.305875:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118744.279560:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118744.279610:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118744.279716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164224 00000100:00100000:1.0:1787118744.279747:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164224 00000100:00100000:1.0:1787118744.279823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:1.0:1787118744.279843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544164224:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118744.279929:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544164224:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 97us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118744.279936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:0.0:1787118744.280135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164096 00000100:00100000:0.0:1787118744.280139:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164096 00000100:00100000:0.0:1787118744.280174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 287 00000100:00100000:0.0:1787118744.280181:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544164096:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118744.280223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544164096:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 34us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118744.280230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 287 00000100:00080000:3.0:1787118744.280513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118744.300166:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118744.300318:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164352 00000100:00100000:1.0:1787118744.300329:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164352 00000100:00100000:1.0:1787118744.300407:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:1.0:1787118744.300419:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2367:x1873929544164352:12345-192.168.203.10@tcp:9:kworker.0 00000020:00000080:1.0:1787118744.300447:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8702 00000100:00080000:1.0:1787118744.300455:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9612423d1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787118744.300511:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787118744.300797:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+2:2367:x1873929544164352:12345-192.168.203.10@tcp:9:kworker.0 Request processed in 380us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118744.300806:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00080000:3.0:1787118744.301608:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787118744.302681:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118744.311147:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118744.318817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164480 00000100:00100000:0.0:1787118744.318831:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164480 00000100:00100000:0.0:1787118744.318918:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 127 00000100:00100000:0.0:1787118744.318929:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544164480:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118744.319021:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544164480:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 92us (7882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118744.319029:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 127 00000100:00080000:3.0:1787118744.319688:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118744.330256:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118745.354092:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118745.418071:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566222336:0@lo:400:kworker.0 00000100:00100000:1.0:1787118745.418143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118745.418245:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118745.418259:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566222208:0@lo:400:kworker.0 00000100:00100000:2.0:1787118745.418293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118745.418350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222208 00000100:00100000:2.0:1787118745.418368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222208 00000100:00100000:2.0:1787118745.418418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787118745.418441:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566222208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118745.418488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566222208:12345-0@lo:400:kworker.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118745.418495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787118745.418539:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566222208:0@lo:400:kworker.0 00000100:00100000:2.0:1787118745.418585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222336 00000100:00100000:2.0:1787118745.418589:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222336 00000100:00100000:2.0:1787118745.418629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787118745.418637:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566222336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118745.420146:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566222464:0@lo:400:kworker.0 00000100:00100000:3.0:1787118745.420194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118745.420262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222464 00000100:00100000:3.0:1787118745.420278:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222464 00000100:00100000:3.0:1787118745.420327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787118745.420335:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118745.420395:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566222464:12345-0@lo:400:kworker.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118745.420401:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1787118745.420420:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118745.420446:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566222464:0@lo:400:kworker.0 00000100:00100000:0.0:1787118745.428579:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118745.428599:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566222848:0@lo:400:kworker.0 00000100:00100000:1.0:1787118745.428642:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566222720:0@lo:400:kworker.0 00000100:00100000:1.0:1787118745.428686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118745.428698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118745.428742:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118745.428751:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566222592:0@lo:400:kworker.0 00000100:00100000:0.0:1787118745.428764:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222848 00000100:00100000:0.0:1787118745.428772:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222848 00000100:00100000:1.0:1787118745.428778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118745.428812:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222592 00000100:00100000:1.0:1787118745.428816:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222592 00000100:00100000:0.0:1787118745.428839:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787118745.428849:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566222848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118745.428899:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566222848:12345-0@lo:400:kworker.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118745.428906:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787118745.429127:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222720 00000100:00100000:3.0:1787118745.429132:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222720 00000100:00100000:3.0:1787118745.429163:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787118745.429171:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566222720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118745.429243:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566222720:12345-0@lo:400:kworker.0 Request processed in 54us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118745.429250:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787118745.429292:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566222720:0@lo:400:kworker.0 00000100:00080000:3.0:1787118745.429337:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118745.429342:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118745.429344:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118745.431838:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566222336:12345-0@lo:400:kworker.0 Request processed in 13191us (13684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118745.431851:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787118745.431943:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118745.431961:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566222592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118745.432647:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566222592:12345-0@lo:400:kworker.0 Request processed in 692us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118745.432655:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118745.432708:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566222336:0@lo:400:kworker.0 00000100:00100000:2.0:1787118745.432712:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566222592:0@lo:400:kworker.0 00010000:00080000:1.0:1787118745.432786:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9613500e8700 x1873929566222848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118745.432799:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566222848:0@lo:400:kworker.0 00000100:00100000:1.0:1787118745.931626:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566222976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118745.931694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118745.932199:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566222976 00000100:00100000:0.0:1787118745.932218:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566222976 00000100:00100000:0.0:1787118745.932283:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787118745.932292:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566222976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118745.932326:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118745.932383:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566222976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118745.932390:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787118745.932523:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9b6a00 x1873929566222976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118745.932542:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566222976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118746.377893:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118746.442042:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566223104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118746.442108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118746.442234:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223104 00000100:00100000:3.0:1787118746.442242:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223104 00000100:00100000:3.0:1787118746.442293:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118746.442302:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566223104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118746.442356:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118746.442404:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566223104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118746.442411:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787118746.442449:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566223104:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787118746.502551:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:2.0:1787118746.502560:0:6728:0:(genops.c:906:class_export_put()) final put ffff96136eb54800/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:0.0:1787118746.502671:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb54800/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-OST0000 00000020:00000080:0.0:1787118746.502744:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9612423d1000 for lustre-OST0000 00010000:00010000:2.0:1787118747.402178:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118748.426896:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118749.403573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118749.403772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164736 00000100:00100000:3.0:1787118749.403783:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164736 00000100:00100000:3.0:1787118749.403855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 131 00000100:00100000:3.0:1787118749.403865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544164736:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118749.403940:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544164736:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00080000:0.0:1787118749.404302:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118749.404755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 131 00000100:00100000:1.0:1787118749.416634:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118749.416685:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118749.416826:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164864 00000100:00100000:1.0:1787118749.416835:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164864 00000100:00100000:1.0:1787118749.416892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 132 00000100:00100000:1.0:1787118749.416902:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544164864:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118749.416971:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544164864:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118749.416979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 132 00000100:00100000:0.0:1787118749.417371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164608 00000100:00100000:0.0:1787118749.417376:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164608 00000100:00100000:0.0:1787118749.417417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 289 00000100:00100000:0.0:1787118749.417424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544164608:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118749.417462:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544164608:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 38us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118749.417469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 289 00000100:00080000:0.0:1787118749.417496:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787118749.451264:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118750.474450:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118750.538961:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566223360:0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.539023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118750.539078:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566223872:0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.539100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118750.539126:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787118750.539142:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566223488:0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.539162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118750.539202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223360 00000100:00100000:1.0:1787118750.539209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223360 00000100:00100000:1.0:1787118750.539375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223488 00000100:00100000:1.0:1787118750.539379:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223488 00000100:00100000:1.0:1787118750.539411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787118750.539419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566223360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.539470:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566223360:12345-0@lo:400:kworker.0 Request processed in 50us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118750.539477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787118750.539492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787118750.539499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566223488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.539525:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566223488:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118750.539531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787118750.539549:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223872 00000100:00100000:1.0:1787118750.539552:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223872 00000100:00080000:0.0:1787118750.539666:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118750.539671:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118750.539717:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566223488:0@lo:400:kworker.0 00000100:00100000:0.0:1787118750.539744:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566223360:0@lo:400:kworker.0 00000100:00100000:3.0:1787118750.539814:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566223616:0@lo:400:kworker.0 00000100:00100000:3.0:1787118750.539838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118750.539927:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566223232:0@lo:400:kworker.0 00000100:00100000:2.0:1787118750.539951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118750.539976:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566223744:0@lo:400:kworker.0 00000100:00100000:2.0:1787118750.539990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118750.540036:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223232 00000100:00100000:0.0:1787118750.540039:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223232 00000100:00100000:0.0:1787118750.540066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787118750.540072:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566223232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118750.540111:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566223232:12345-0@lo:400:kworker.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118750.540126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787118750.541712:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223744 00000100:00100000:0.0:1787118750.541736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223744 00000100:00100000:0.0:1787118750.541793:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787118750.541801:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118750.541863:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566223744:12345-0@lo:400:kworker.0 Request processed in 63us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118750.541938:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1787118750.541963:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118750.542197:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566223616 00000100:00100000:1.0:1787118750.542202:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566223616 00000100:00100000:1.0:1787118750.542799:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787118750.542808:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566223872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.542864:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566223872:12345-0@lo:400:kworker.0 Request processed in 57us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118750.542882:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787118750.542895:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787118750.542901:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566223616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.542952:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566223616:12345-0@lo:400:kworker.0 Request processed in 51us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118750.542958:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787118750.542997:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566223616:0@lo:400:kworker.0 00010000:00080000:1.0:1787118750.543053:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9b5880 x1873929566223872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118750.543065:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566223872:0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.543107:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566223232:0@lo:400:kworker.0 00000100:00100000:1.0:1787118750.543117:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566223744:0@lo:400:kworker.0 00000100:00080000:3.0:1787118750.543450:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787118750.666785:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787118751.050516:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566224000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118751.050658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118751.050836:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224000 00000100:00100000:0.0:1787118751.050845:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224000 00000100:00100000:0.0:1787118751.050899:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787118751.050909:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566224000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118751.051336:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118751.051395:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566224000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 487us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118751.051411:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787118751.052703:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9b4a80 x1873929566224000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118751.052748:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566224000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118751.498395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118751.562906:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566224128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118751.562978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118751.563071:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224128 00000100:00100000:1.0:1787118751.563079:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224128 00000100:00100000:1.0:1787118751.563125:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787118751.563135:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566224128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787118751.563176:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118751.563229:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566224128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118751.563236:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787118751.563291:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566224128:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787118752.141004:0:11861:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:52:29 (1787118749) 00010000:00010000:3.0:1787118752.521905:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118753.546998:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118754.308437:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118754.308595:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544164992 00000100:00100000:0.0:1787118754.308604:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544164992 00000100:00100000:0.0:1787118754.308672:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:0.0:1787118754.308682:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:10258:x1873929544164992:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118754.308701:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118754.308769:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f87cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b92d expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.308829:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.308854:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.308867:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118754.309054:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787118754.309057:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118754.309140:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.309176:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f87cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b92d expref: 7 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.309192:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b92d expref: 6 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.309200:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704a00) 00010000:00010000:0.0:1787118754.309203:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118754.309206:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030400, rc 0) 00000100:00100000:0.0:1787118754.309267:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:10258:x1873929544164992:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 586us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118754.309273:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00080000:3.0:1787118754.309845:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118754.324140:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118754.324254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165120 00000100:00100000:0.0:1787118754.324264:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165120 00000100:00100000:0.0:1787118754.324329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:0.0:1787118754.324340:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:10259:x1873929544165120:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118754.324361:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118754.324405:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f87db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b934 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324470:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324484:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324495:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324511:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324518:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.324524:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.325201:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.325214:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.325221:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118754.325307:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787118754.325311:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118754.326517:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.326564:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.326572:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.326581:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.326588:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118754.326593:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.326600:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328507:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704a00) 00010000:00010000:0.0:1787118754.328516:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118754.328522:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f87e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328553:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328571:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328578:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328599:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118754.328603:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328609:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328619:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff961351704f00) 00010000:00010000:0.0:1787118754.328621:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118754.328624:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.328630:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f87e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.329632:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f87db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b934 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.329773:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b934 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118754.329783:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961351704000) 00010000:00010000:0.0:1787118754.329786:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118754.329788:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031800, rc 0) 00000100:00100000:0.0:1787118754.329868:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:10259:x1873929544165120:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 5529us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118754.329876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:0.0:1787118754.350312:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118754.350559:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165376 00000100:00100000:3.0:1787118754.350578:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165376 00000100:00100000:3.0:1787118754.350662:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:3.0:1787118754.350675:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:10259:x1873929544165376:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118754.350704:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118754.350883:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f87f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b93b expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.350984:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.351000:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.351012:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.354378:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.354402:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.354413:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355395:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f880c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355411:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f880c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355433:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f880c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118754.355463:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787118754.355682:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355689:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355695:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355702:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118754.355706:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355714:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355751:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961351704000) 00010000:00010000:3.0:1787118754.355754:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118754.355759:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355764:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f87fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355775:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355781:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355796:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355801:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118754.355804:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355809:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355817:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961359bc8500) 00010000:00010000:3.0:1787118754.355820:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118754.355823:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.355829:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8805 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.361778:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f87f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b93b expref: 10 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.361809:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f880c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b93b expref: 9 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118754.361819:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:3.0:1787118754.361822:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118754.361825:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c000, rc 0) 00000100:00100000:3.0:1787118754.362842:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+9:10259:x1873929544165376:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 12161us (12544us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787118754.363068:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:1.0:1787118754.372264:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118754.372430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165504 00000100:00100000:2.0:1787118754.372439:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165504 00000100:00100000:2.0:1787118754.373842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:2.0:1787118754.373874:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:10259:x1873929544165504:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787118754.374274:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:10259:x1873929544165504:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 Request processed in 408us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118754.380927:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:0.0:1787118754.534313:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118754.534362:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118754.534432:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165760 00000100:00100000:1.0:1787118754.534441:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165760 00000100:00100000:1.0:1787118754.534510:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 136 00000100:00100000:1.0:1787118754.534521:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544165760:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118754.534594:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544165760:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118754.534602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 136 00000100:00100000:2.0:1787118754.534987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165632 00000100:00100000:2.0:1787118754.534992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165632 00000100:00100000:2.0:1787118754.535032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 291 00000100:00100000:2.0:1787118754.535040:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544165632:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118754.535078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544165632:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118754.535085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 291 00000100:00080000:0.0:1787118754.535422:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118754.569961:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118754.768702:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787118755.594395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118755.661226:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566224384:0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.661295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118755.661357:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566224896:0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.661382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118755.661413:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118755.661419:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566224512:0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.661442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118755.661476:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224896 00000100:00100000:2.0:1787118755.661482:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224896 00000100:00100000:2.0:1787118755.661549:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787118755.661559:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566224896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.661626:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566224896:12345-0@lo:400:kworker.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118755.661633:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787118755.661656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224384 00000100:00100000:2.0:1787118755.661659:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224384 00000100:00100000:2.0:1787118755.661681:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224512 00000100:00100000:2.0:1787118755.661684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224512 00000100:00100000:2.0:1787118755.661704:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787118755.661711:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566224384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.661768:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566224384:12345-0@lo:400:kworker.0 Request processed in 57us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118755.661786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787118755.661798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787118755.661804:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566224512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.662188:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566224640:0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.662223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118755.662248:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787118755.662256:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566224256:0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.662282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118755.662305:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566224768:0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.662327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118755.662349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224256 00000100:00100000:0.0:1787118755.662354:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224256 00000100:00100000:0.0:1787118755.662383:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787118755.662390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566224256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.662427:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3300:x1873929566224256:12345-0@lo:400:kworker.0 Request processed in 37us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118755.662432:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787118755.662471:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566224256:0@lo:400:kworker.0 00000100:00100000:1.0:1787118755.662568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224768 00000100:00100000:1.0:1787118755.662573:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224768 00000100:00100000:1.0:1787118755.662596:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787118755.662612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566224768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118755.662660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566224768:12345-0@lo:400:kworker.0 Request processed in 49us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118755.662666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787118755.662705:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566224640 00000100:00100000:1.0:1787118755.662709:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566224640 00000100:00100000:1.0:1787118755.662757:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787118755.662764:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118755.663076:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566224640:12345-0@lo:400:kworker.0 Request processed in 45us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118755.663086:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787118755.663117:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118755.663122:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787118755.663124:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118755.663157:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566224384:0@lo:400:kworker.0 00010000:00080000:1.0:1787118755.663171:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961375eb8a80 x1873929566224896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787118771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118755.663198:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566224896:0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.663700:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566224768:0@lo:400:kworker.0 00000100:00100000:0.0:1787118755.663712:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566224640:0@lo:400:kworker.0 00000100:00100000:2.0:1787118755.664939:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566224512:12345-0@lo:400:kworker.0 Request processed in 3118us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118755.664951:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787118755.665319:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566224512:0@lo:400:kworker.0 00000100:00100000:2.0:1787118756.172986:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118756.173055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118756.173184:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566225024 00000100:00100000:0.0:1787118756.173202:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566225024 00000100:00100000:0.0:1787118756.173251:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787118756.173261:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566225024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118756.173308:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118756.173357:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566225024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118756.173364:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787118756.173401:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96136e9b7b80 x1873929566225024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118756.173421:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566225024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118756.618823:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118756.685796:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566225152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118756.685865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118756.685938:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566225152 00000100:00100000:3.0:1787118756.685945:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566225152 00000100:00100000:3.0:1787118756.685989:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787118756.685998:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566225152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118756.686032:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118756.686076:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566225152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118756.686084:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787118756.686141:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566225152:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787118756.765922:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1787118756.913057:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118756.913095:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544165888 00000100:00100000:3.0:1787118756.913104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544165888 00000100:00100000:3.0:1787118756.913175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:3.0:1787118756.913206:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:10302:x1873929544165888:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118756.913225:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118756.913245:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f881a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b942 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913306:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913345:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913358:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913387:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913642:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913650:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913656:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913662:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118756.913667:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913673:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913685:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704a00) 00010000:00010000:3.0:1787118756.913694:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118756.913700:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913706:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913719:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913752:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913758:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913764:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118756.913766:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913772:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961359bc8c00) 00010000:00010000:3.0:1787118756.913781:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118756.913784:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913788:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8828 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913818:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f881a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b942 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913839:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704a00) 00010000:00010000:3.0:1787118756.913841:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118756.913845:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f881a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b942 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118756.913853:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118756.913909:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:10302:x1873929544165888:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 726us (862us total) trans 0 rc 301/301 00000100:00100000:3.0:1787118756.913917:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00080000:3.0:1787118756.913942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118756.921853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118756.921945:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166144 00000100:00100000:0.0:1787118756.921954:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166144 00000100:00100000:0.0:1787118756.922013:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:0.0:1787118756.922023:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:10302:x1873929544166144:12345-192.168.203.10@tcp:36:lfs.0 00010000:00010000:0.0:1787118756.922077:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118756.922105:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f87d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b92d expref: 8 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922124:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704a00) 00010000:00010000:0.0:1787118756.922145:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118756.922419:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922433:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922443:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922454:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922468:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.922475:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118756.923479:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787118756.923492:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923500:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923506:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923512:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118756.923515:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923522:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923533:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704f00) 00010000:00010000:0.0:1787118756.923536:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118756.923540:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.923545:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f882f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118756.923573:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fc0d2e6 reply state 00000000598d5580 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118756.923586:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787118756.923703:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+9:10302:x1873929544166144:12345-192.168.203.10@tcp:36:lfs.0 Request processed in 1679us (1856us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787118756.923711:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 37 00010000:00010000:0.0:1787118756.927745:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927763:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927771:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927778:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118756.927783:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927791:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927807:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961351704800) 00010000:00010000:0.0:1787118756.927811:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118756.927815:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118756.927822:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8836 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118757.076545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118757.077854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166272 00000100:00100000:0.0:1787118757.077866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166272 00000100:00100000:0.0:1787118757.077937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:0.0:1787118757.077947:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:10310:x1873929544166272:12345-192.168.203.10@tcp:101:lctl.0 00010000:00010000:0.0:1787118757.077975:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118757.078000:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f883d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b949 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078066:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078080:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078091:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118757.078157:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787118757.078161:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118757.078212:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078236:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f883d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b949 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078255:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b949 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.078263:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:0.0:1787118757.078279:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118757.078283:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030400, rc 0) 00000100:00100000:0.0:1787118757.078448:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:10310:x1873929544166272:12345-192.168.203.10@tcp:101:lctl.0 Request processed in 501us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118757.078455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:3.0:1787118757.177082:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118757.186452:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166400 00000100:00100000:0.0:1787118757.186469:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166400 00000100:00100000:0.0:1787118757.186551:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:0.0:1787118757.186561:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+9:10316:x1873929544166400:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118757.186581:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.186946:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f884b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b950 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187018:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187033:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187060:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187075:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187082:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187089:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187287:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187295:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187302:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118757.187333:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787118757.187337:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118757.187379:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187391:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187397:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187413:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187419:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.187423:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187429:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187441:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:2.0:1787118757.187444:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.187448:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187454:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187466:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187472:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187477:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187482:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.187484:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187500:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187509:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff96134bc94900) 00010000:00010000:2.0:1787118757.187511:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.187514:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187520:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187550:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f884b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b950 expref: 11 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187561:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b950 expref: 10 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.187568:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118757.187571:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787118757.187573:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986400, rc 0) 00000100:00100000:2.0:1787118757.188200:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+10:10316:x1873929544166400:12345-192.168.203.10@tcp:101:bash.0 Request processed in 1637us (11126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.188210:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:1.0:1787118757.199941:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118757.200149:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166656 00000100:00100000:0.0:1787118757.200159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166656 00000100:00100000:0.0:1787118757.200227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:0.0:1787118757.200237:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+10:10316:x1873929544166656:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118757.200257:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118757.200278:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8867 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b957 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200410:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200425:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200436:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200488:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200512:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.200531:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787118757.201371:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787118757.201555:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.201568:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.201577:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213018:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213036:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213062:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213069:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.213074:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213082:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213097:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118757.213100:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.213105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213111:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f886e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118757.213140:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043de3aba reply state 0000000037778b49 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118757.213150:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787118757.213208:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8867 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213225:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.213233:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:2.0:1787118757.213236:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118757.213246:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031400, rc 0) 00000100:00100000:2.0:1787118757.213334:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+13:10316:x1873929544166656:12345-192.168.203.10@tcp:101:bash.0 Request processed in 13098us (13402us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787118757.213343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 40 00010000:00010000:2.0:1787118757.216272:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216298:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216306:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216312:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.216317:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216325:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216340:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff961351704f00) 00010000:00010000:2.0:1787118757.216343:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.216347:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.216353:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118757.218261:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.218342:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166784 00000100:00100000:2.0:1787118757.218352:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166784 00000100:00100000:2.0:1787118757.218395:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:2.0:1787118757.218403:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544166784:12345-192.168.203.10@tcp:8:bash.0 00010000:00080000:2.0:1787118757.218446:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:2.0:1787118757.218472:0:6703:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f888a 00002000:00100000:2.0:1787118757.218484:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4b9d85e8-2500-4b81-a525-0303ce911299/ffff96136e9b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787118757.218495:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787118757.218783:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787118757.218814:0:6703:0:(import.c:65:import_set_state_nolock()) ffff96136e9ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118757.218892:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544166784:12345-192.168.203.10@tcp:8:bash.0 Request processed in 487us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.218899:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:1.0:1787118757.231274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.231372:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544166912 00000100:00100000:2.0:1787118757.231382:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544166912 00000100:00100000:2.0:1787118757.231454:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:2.0:1787118757.231463:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:0:x1873929544166912:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118757.231480:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.231502:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b95e expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787118757.231539:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787118757.231557:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1787118757.231562:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118757.231572:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.231609:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.231652:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:2.0:1787118757.231718:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:0:x1873929544166912:12345-192.168.203.10@tcp:101:bash.0 Request processed in 255us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.231756:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00080000:3.0:1787118757.232373:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118757.239095:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.239433:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544167040 00000100:00100000:2.0:1787118757.239442:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544167040 00000100:00100000:2.0:1787118757.239508:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:2.0:1787118757.239518:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:10316:x1873929544167040:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118757.239546:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.239565:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b965 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.239610:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.239619:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118757.239624:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118757.240303:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.240345:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.240360:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118757.240390:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566225280:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118757.240492:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118757.247109:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566225280:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118757.247154:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.247174:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118757.247235:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:10316:x1873929544167040:12345-192.168.203.10@tcp:101:bash.0 Request processed in 7718us (8148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.247244:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:1.0:1787118757.251167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118757.251924:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544167168 00000100:00100000:3.0:1787118757.251934:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544167168 00010000:00010000:3.0:1787118757.251974:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118757.252068:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:3.0:1787118757.252078:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544167168:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118757.252092:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118757.252113:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.252161:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.252198:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f8891 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b95e expref: 8 pid: 8419 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.252214:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118757.252219:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118757.252227:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.252237:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.252282:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118757.252296:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566225408:192.168.203.10@tcp:105: 00000100:00100000:3.0:1787118757.252381:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992540 going to sleep for 11 seconds 00000100:00100000:1.0:1787118757.261223:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566225408:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118757.261248:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118757.261304:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544167168:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 9227us (10146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118757.261315:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:0.0:1787118757.264498:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118757.264580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544167424 00000100:00100000:3.0:1787118757.264598:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544167424 00000100:00100000:3.0:1787118757.264666:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:3.0:1787118757.264678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+12:10316:x1873929544167424:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:3.0:1787118757.265033:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:10316:x1873929544167424:12345-192.168.203.10@tcp:35:bash.0 Request processed in 356us (542us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787118757.265053:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:3.0:1787118757.402792:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.403053:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544167680 00000100:00100000:2.0:1787118757.403064:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544167680 00000100:00100000:2.0:1787118757.403142:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:2.0:1787118757.403153:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+13:10326:x1873929544167680:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118757.403180:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.403202:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f889f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b96c expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118757.403315:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787118757.403432:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f889f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b96c expref: 15 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.403446:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:2.0:1787118757.403449:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118757.403466:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f889f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b96c expref: 15 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.403479:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987000, rc 0) 00000100:00100000:2.0:1787118757.403528:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:10326:x1873929544167680:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 377us (746us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787118757.403535:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:3.0:1787118757.409953:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.410461:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544167936 00000100:00100000:2.0:1787118757.410470:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544167936 00000100:00100000:2.0:1787118757.410525:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:2.0:1787118757.410534:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:10326:x1873929544167936:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118757.410836:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+15:10326:x1873929544167936:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 295us (889us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787118757.410843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:0.0:1787118757.561283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118757.567247:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168064 00000100:00100000:3.0:1787118757.567262:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168064 00000100:00100000:3.0:1787118757.568048:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:3.0:1787118757.568063:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+15:10332:x1873929544168064:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118757.568086:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118757.568116:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b973 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568191:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568204:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568216:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118757.568274:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787118757.568278:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118757.568303:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568330:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b973 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568347:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b973 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.568368:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118757.568371:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787118757.568375:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118757.568462:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+16:10332:x1873929544168064:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 404us (7187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118757.568469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:3.0:1787118757.587446:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.587988:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168320 00000100:00100000:2.0:1787118757.587998:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168320 00000100:00100000:3.0:1787118757.588341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:3.0:1787118757.588355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:10332:x1873929544168320:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118757.588375:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118757.588395:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b97a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.588489:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f88c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.588503:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.588515:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118757.588525:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787118757.590706:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b97a expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.590758:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b97a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.590926:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:3.0:1787118757.590931:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118757.590935:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d800, rc 0) 00000100:00100000:2.0:1787118757.592556:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+18:10332:x1873929544168320:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 4195us (5108us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787118757.592568:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:0.0:1787118757.605037:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118757.605168:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118757.605667:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168704 00000100:00100000:1.0:1787118757.605677:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168704 00000100:00100000:1.0:1787118757.605776:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:1.0:1787118757.605787:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+18:2368:x1873929544168704:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118757.605802:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118757.605825:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f88c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b97a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.605845:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:1.0:1787118757.605849:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118757.605910:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+17:2368:x1873929544168704:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 125us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118757.605918:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:2.0:1787118757.607001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168576 00000100:00100000:2.0:1787118757.607010:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168576 00000100:00100000:2.0:1787118757.607105:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:2.0:1787118757.607120:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+17:10332:x1873929544168576:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118757.607151:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.607167:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f88d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b981 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.607271:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.607283:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.607293:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118757.607305:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787118757.607428:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f88d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b981 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.607698:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b981 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.607707:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:2.0:1787118757.607710:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787118757.607713:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987400, rc 0) 00000100:00100000:2.0:1787118757.607834:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:10332:x1873929544168576:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 715us (2806us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787118757.607841:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:0.0:1787118757.628044:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.628291:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168832 00000100:00100000:2.0:1787118757.628301:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168832 00000100:00100000:2.0:1787118757.628407:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:2.0:1787118757.628418:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544168832:12345-192.168.203.10@tcp:1:lfs.0 00010000:00010000:2.0:1787118757.628476:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.628510:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.628519:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118757.628523:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787118757.628527:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.628561:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.628574:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 7 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118757.628599:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566225536:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118757.628696:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118757.638160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118757.638876:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544168960 00000100:00100000:3.0:1787118757.638885:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544168960 00002000:00100000:3.0:1787118757.638933:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9613500e8700 x1873929544168960/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:548/0 lens 504/0 e 0 to 0 dl 1787118768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118757.638943:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9613500e8700 with x1873929544168960 ext(0->12) 00010000:00010000:3.0:1787118757.638951:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 8 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.638968:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 8 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118757.638975:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9613500e8700 00000100:00100000:3.0:1787118757.639007:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118757.639017:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544168960:12345-192.168.203.10@tcp:4:lfs.0 00000100:00100000:2.0:1787118757.639253:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566225536:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118757.639321:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.651772:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787118757.720519:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000100:00100000:1.0:1787118757.725162:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544168960:12345-192.168.203.10@tcp:4:lfs.0 Request processed in 86137us (87002us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787118757.725360:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00002000:00100000:1.0:1787118757.725375:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9613500e8700 x1873929544168960/t4294967299(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:548/0 lens 504/448 e 0 to 0 dl 1787118768 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787118757.725384:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9613500e8700 with x1873929544168960 ext(0->12) 00010000:00010000:1.0:1787118757.725406:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.725425:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787118757.725433:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9613500e8700 00000100:00100000:0.0:1787118757.732482:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118757.738112:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544169088 00000100:00100000:1.0:1787118757.738138:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544169088 00010000:00010000:1.0:1787118757.738197:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118757.738245:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:1.0:1787118757.738255:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544169088:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118757.738269:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787118757.738287:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787118757.738290:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787118756 00002000:00010000:1.0:1787118757.738292:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787118756 00002000:00010000:1.0:1787118757.738294:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787118756 00010000:00010000:1.0:1787118757.738325:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.738338:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.738362:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ed023e/0xaa534e3c784f8898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b965 expref: 9 pid: 6703 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.738378:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118757.738382:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118757.738388:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.738398:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.738435:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118757.738499:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544169088:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 245us (6025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118757.738507:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 36 00010000:00010000:0.0:1787118757.739763:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739780:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739812:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739843:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739852:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739858:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118757.739863:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739872:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739891:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.739898:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f88e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118757.739980:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544168832:12345-192.168.203.10@tcp:1:lfs.0 Request processed in 111561us (111943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118757.739989:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:0.0:1787118757.745025:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.745111:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544169344 00000100:00100000:2.0:1787118757.745120:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544169344 00000100:00100000:2.0:1787118757.745365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118757.745373:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:10332:x1873929544169344:12345-192.168.203.10@tcp:35:lfs.0 00000004:00010000:2.0:1787118757.745443:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b981 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118757.745780:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787118757.746554:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787118757.748289:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787118757.748538:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.748558:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.748580:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.748676:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.748692:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 23 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118757.748705:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9dea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566225664:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118757.751345:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118757.755018:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9dea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566225664:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118757.755062:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118757.755550:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118757.755866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544169472 00000100:00100000:1.0:1787118757.755874:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544169472 00010000:00010000:1.0:1787118757.755909:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 24 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118757.755950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:1.0:1787118757.755960:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+24:2369:x1873929544169472:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118757.755983:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118757.755990:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 24 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756004:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 24 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756026:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f887c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b957 expref: 24 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756044:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:1.0:1787118757.756048:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756057:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756065:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118757.756090:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118757.756166:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:2369:x1873929544169472:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 207us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118757.756174:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 37 00010000:00010000:0.0:1787118757.757481:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118757.757495:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118757.757687:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787118757.757987:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787118757.758171:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566225792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787118757.758571:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118757.758790:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566225792 00000100:00100000:2.0:1787118757.758797:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566225792 00000100:00100000:2.0:1787118757.758957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118757.758965:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566225792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787118757.759036:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566225792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.759042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118757.759063:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350ff2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118757.759084:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9b6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566225792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787118757.759800:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787118757.759986:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566225920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787118757.760036:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118757.760069:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118757.760302:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566225920 00000100:00100000:0.0:1787118757.760319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566225920 00000100:00100000:0.0:1787118757.760347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118757.760355:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566225920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787118757.760513:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1873929566225920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 158us (476us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787118757.760520:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118757.760810:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566225920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787118757.760939:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787118757.760980:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.760992:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.760999:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.761014:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.761018:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.761026:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.761041:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:2.0:1787118757.761044:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787118757.761048:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.761053:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f88ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787118757.761437:0:5845:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787118757.761949:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787118757.761961:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336919238430ns, next at 337919236090ns, rc = 0 00000001:00080000:2.0:1787118757.761968:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787118757.762007:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961351704a00) 00010000:00010000:2.0:1787118757.762010:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787118757.762018:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f88d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b981 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118757.762304:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+26:10332:x1873929544169344:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 16929us (17285us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787118757.762321:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000020:00080000:2.0:1787118757.762326:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787118757.762408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118757.767407:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.767473:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544169600 00000100:00100000:2.0:1787118757.767482:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544169600 00000100:00100000:2.0:1787118757.767546:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:2.0:1787118757.767556:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+26:10332:x1873929544169600:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118757.767580:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118757.767612:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f88f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b988 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.767670:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f88f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b988 expref: 27 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.767684:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f88f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b988 expref: 27 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.767704:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118757.767707:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118757.767712:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118757.767796:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+27:10332:x1873929544169600:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 241us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.767803:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:0.0:1787118757.774380:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118757.774510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544169856 00000100:00100000:1.0:1787118757.774520:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544169856 00000100:00100000:1.0:1787118757.774576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:1.0:1787118757.774598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+27:10332:x1873929544169856:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118757.775503:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+28:10332:x1873929544169856:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 912us (1125us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787118757.775512:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:1.0:1787118757.909530:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118757.909698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544170112 00000100:00100000:3.0:1787118757.909708:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544170112 00000100:00100000:3.0:1787118757.909806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:3.0:1787118757.909815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+28:10342:x1873929544170112:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118757.909838:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118757.909858:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f88fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b98f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118757.909966:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787118757.910080:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f88fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b98f expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.910693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:3.0:1787118757.910699:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118757.910716:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f88fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b98f expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118757.910755:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118757.910866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+29:10342:x1873929544170112:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1051us (1345us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787118757.910874:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:0.0:1787118757.916692:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.916902:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544170240 00000100:00100000:2.0:1787118757.916913:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544170240 00000100:00100000:2.0:1787118757.917001:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:2.0:1787118757.917012:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:10342:x1873929544170240:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:2.0:1787118757.917088:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917129:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917158:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917174:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917295:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917605:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917701:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917710:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917716:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118757.917949:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917963:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917969:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917976:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.917993:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.917997:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918005:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918017:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118757.918019:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.918023:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918029:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918041:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918046:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918051:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918055:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.918058:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918063:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918079:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94c00) 00010000:00010000:2.0:1787118757.918081:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.918084:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918089:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f890f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918246:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918254:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918259:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918263:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118757.918266:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918271:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918279:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118757.918281:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118757.918283:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118757.918288:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118757.918711:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:10342:x1873929544170240:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 1697us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118757.918757:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:0.0:1787118757.922432:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118757.922684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544170496 00000100:00100000:2.0:1787118757.922693:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544170496 00000100:00100000:2.0:1787118757.922853:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:2.0:1787118757.922864:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+29:10342:x1873929544170496:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118757.923134:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+30:10342:x1873929544170496:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 271us (709us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787118757.923142:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:1.0:1787118758.014025:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.014139:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544170752 00000100:00100000:2.0:1787118758.014148:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544170752 00000100:00100000:2.0:1787118758.014228:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:2.0:1787118758.014239:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+30:10345:x1873929544170752:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118758.014262:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118758.014284:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f891d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b996 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014353:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014366:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014376:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014407:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014415:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014422:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014549:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014556:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118758.014566:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787118758.014655:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014663:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014669:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014675:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118758.014679:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014695:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014708:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118758.014711:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118758.014715:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014758:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014772:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014778:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014783:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014788:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118758.014790:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014796:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014803:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94c00) 00010000:00010000:2.0:1787118758.014805:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118758.014808:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014822:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f892b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014860:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f891d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014872:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.014879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118758.014882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118758.014884:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987600, rc 0) 00000100:00100000:2.0:1787118758.014931:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+32:10345:x1873929544170752:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 693us (916us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787118758.014937:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00080000:3.0:1787118758.015462:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118758.018477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.018864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544170880 00000100:00100000:2.0:1787118758.018875:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544170880 00000100:00100000:2.0:1787118758.018941:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:2.0:1787118758.018951:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:10345:x1873929544170880:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:2.0:1787118758.019020:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019037:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019048:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019399:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019408:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019414:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019420:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118758.019424:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019432:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019444:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118758.019447:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118758.019451:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.019457:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118758.019541:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:10345:x1873929544170880:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 591us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118758.019549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:0.0:1787118758.022939:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.023028:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544171136 00000100:00100000:2.0:1787118758.023038:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544171136 00000100:00100000:2.0:1787118758.023102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118758.023136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:10345:x1873929544171136:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118758.023368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:10345:x1873929544171136:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 235us (437us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787118758.023376:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:0.0:1787118758.398715:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.398914:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544171392 00000100:00100000:2.0:1787118758.398924:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544171392 00000100:00100000:2.0:1787118758.398987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:2.0:1787118758.398998:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+33:10376:x1873929544171392:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:2.0:1787118758.399022:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118758.399043:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b99d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.399163:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f894e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.399177:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f894e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.399188:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f894e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118758.399200:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787118758.399357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b99d expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.399377:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f894e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b99d expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.399399:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118758.399402:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118758.399406:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986800, rc 0) 00000100:00100000:2.0:1787118758.399466:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+35:10376:x1873929544171392:12345-192.168.203.10@tcp:101:cat.0 Request processed in 470us (761us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787118758.399474:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:0.0:1787118758.416706:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118758.416823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.416960:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544171776 00000100:00100000:2.0:1787118758.416969:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544171776 00000100:00100000:2.0:1787118758.417023:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:2.0:1787118758.417033:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+35:10376:x1873929544171776:12345-192.168.203.10@tcp:35:cat.0 00000100:00100000:2.0:1787118758.417290:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+36:10376:x1873929544171776:12345-192.168.203.10@tcp:35:cat.0 Request processed in 258us (466us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787118758.417298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:1.0:1787118758.425203:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544171520 00000100:00100000:1.0:1787118758.425217:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544171520 00000100:00100000:1.0:1787118758.425308:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:1.0:1787118758.425318:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350045450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+36:2368:x1873929544171520:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118758.425335:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118758.425360:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f894e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b99d expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.425381:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118758.425386:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118758.425452:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350045450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:2368:x1873929544171520:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 135us (8754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118758.425460:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:0.0:1787118758.477141:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.477291:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172032 00000100:00100000:2.0:1787118758.477300:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172032 00000100:00100000:2.0:1787118758.477360:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:2.0:1787118758.477370:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:10382:x1873929544172032:12345-192.168.203.10@tcp:101:dd.0 00010000:00010000:2.0:1787118758.477395:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118758.477398:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787118758.477426:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f88b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b973 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477447:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118758.477452:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118758.477465:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f895c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9a4 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477585:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477599:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477608:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477878:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.477893:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 35 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118758.477908:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566226048:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118758.478007:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118758.480844:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566226048:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118758.480873:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118758.492506:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118758.494413:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172160 00000100:00100000:3.0:1787118758.494426:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172160 00010000:00010000:3.0:1787118758.494475:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118758.494532:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:3.0:1787118758.494542:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+36:2369:x1873929544172160:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118758.494558:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118758.494565:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494580:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494615:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b996 expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494634:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:3.0:1787118758.494638:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494666:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494767:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118758.494800:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118758.494816:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.494824:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118758.494843:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1787118758.494975:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+36:2369:x1873929544172160:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 434us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118758.494983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 38 00010000:00010000:2.0:1787118758.495027:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f895c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 36 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.495043:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 35 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.495051:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118758.495054:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118758.495056:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987400, rc 0) 00000100:00100000:2.0:1787118758.495082:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:10382:x1873929544172032:12345-192.168.203.10@tcp:101:dd.0 Request processed in 17713us (17952us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787118758.495089:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:0.0:1787118758.503899:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.503956:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172416 00000100:00100000:2.0:1787118758.503966:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172416 00000100:00100000:2.0:1787118758.504027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:2.0:1787118758.504038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+35:10382:x1873929544172416:12345-192.168.203.10@tcp:36:dd.0 00010000:00010000:2.0:1787118758.504316:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.504334:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.504345:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118758.504397:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787118758.504423:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd7abf3e reply state 000000007421c197 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118758.504432:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118758.504550:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+38:10382:x1873929544172416:12345-192.168.203.10@tcp:36:dd.0 Request processed in 513us (659us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787118758.504556:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 52 00000020:00080000:2.0:1787118758.504561:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787118758.509985:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510002:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510009:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510015:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118758.510032:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510039:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510054:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118758.510058:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118758.510062:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.510069:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8971 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118758.666146:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118758.932337:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.933140:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172544 00000100:00100000:2.0:1787118758.933151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172544 00000100:00100000:2.0:1787118758.933215:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:2.0:1787118758.933226:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+37:10396:x1873929544172544:12345-192.168.203.10@tcp:101:stat.0 00010000:00010000:2.0:1787118758.933248:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118758.933268:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933351:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933365:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933378:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933392:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933399:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933406:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933510:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933527:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 38 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933536:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933570:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 38 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.933597:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 38 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118758.933611:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566226176:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118758.933717:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118758.943303:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566226176:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118758.943335:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118758.947302:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118758.947393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172800 00000100:00100000:2.0:1787118758.947402:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172800 00000100:00100000:2.0:1787118758.947461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:2.0:1787118758.947479:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+39:9983:x1873929544172800:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787118758.948225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+40:9983:x1873929544172800:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 744us (929us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787118758.948236:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118758.958133:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118758.958223:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544172928 00000100:00100000:1.0:1787118758.958233:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544172928 00010000:00010000:1.0:1787118758.958272:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 40 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118758.958311:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:1.0:1787118758.958321:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+40:2368:x1873929544172928:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118758.958335:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118758.958343:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 40 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958355:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 40 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958377:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8963 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9a4 expref: 40 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958414:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118758.958419:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958429:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958436:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118758.958474:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118758.958527:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+39:2368:x1873929544172928:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 207us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118758.958535:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00010000:00010000:2.0:1787118758.959487:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959512:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118758.959559:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787118758.959564:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118758.959625:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959640:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959648:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959655:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959662:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959668:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118758.959672:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.959680:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960046:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118758.960049:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118758.960053:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960070:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f897f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960086:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960092:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960098:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960103:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118758.960106:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960120:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960130:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94c00) 00010000:00010000:2.0:1787118758.960133:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118758.960136:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960141:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960182:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ab expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960196:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ab expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118758.960211:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118758.960214:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118758.960216:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118758.960794:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+38:10396:x1873929544172544:12345-192.168.203.10@tcp:101:stat.0 Request processed in 27565us (28462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118758.960804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:0.0:1787118759.051935:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.053488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544173184 00000100:00100000:2.0:1787118759.053501:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544173184 00000100:00100000:2.0:1787118759.053570:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 54 00000100:00100000:2.0:1787118759.053581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+38:10402:x1873929544173184:12345-192.168.203.10@tcp:36:truncate.0 00010000:00010000:2.0:1787118759.053645:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118759.053672:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f898d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ab expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.053692:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.053698:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118759.053927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.053941:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.053951:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118759.054000:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787118759.054028:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb5370b reply state 00000000713f4f6e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.054051:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118759.054177:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+40:10402:x1873929544173184:12345-192.168.203.10@tcp:36:truncate.0 Request processed in 598us (2252us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787118759.054185:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 54 00000020:00080000:2.0:1787118759.054190:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787118759.061787:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061805:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061811:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061817:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118759.061822:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061829:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061844:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.061847:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118759.061851:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.061858:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8994 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118759.312447:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.312552:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544173312 00000100:00100000:2.0:1787118759.312574:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544173312 00000100:00100000:2.0:1787118759.312648:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:2.0:1787118759.312658:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+39:10416:x1873929544173312:12345-192.168.203.10@tcp:101:stat.0 00010000:00010000:2.0:1787118759.312681:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.312704:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f899b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9b2 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312801:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312815:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312825:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312839:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312846:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312851:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312941:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312950:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.312956:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.312994:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787118759.312998:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118759.313017:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313028:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313035:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313040:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313046:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313051:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118759.313318:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313328:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313341:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118759.313344:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118759.313348:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313355:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313378:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313385:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313391:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313396:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118759.313399:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313406:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313412:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94c00) 00010000:00010000:2.0:1787118759.313415:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118759.313418:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313424:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313453:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f899b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 41 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313466:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 40 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.313489:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.313491:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118759.313494:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987a00, rc 0) 00000100:00100000:2.0:1787118759.313556:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+40:10416:x1873929544173312:12345-192.168.203.10@tcp:101:stat.0 Request processed in 900us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118759.313564:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:0.0:1787118759.454977:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.455090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544173568 00000100:00100000:2.0:1787118759.455100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544173568 00000100:00100000:2.0:1787118759.455177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:2.0:1787118759.455187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+40:10426:x1873929544173568:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118759.455207:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.455228:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9b9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.455340:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787118759.455457:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b9 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.455471:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:2.0:1787118759.455475:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118759.455479:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b9 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.455494:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118759.455557:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+41:10426:x1873929544173568:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 372us (590us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787118759.455590:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:0.0:1787118759.464437:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.464532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544173824 00000100:00100000:2.0:1787118759.464543:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544173824 00000100:00100000:2.0:1787118759.464608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:2.0:1787118759.464618:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+41:10426:x1873929544173824:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118759.465055:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+42:10426:x1873929544173824:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 437us (626us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787118759.465064:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:0.0:1787118759.538004:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.538090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174080 00000100:00100000:2.0:1787118759.538099:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174080 00000100:00100000:2.0:1787118759.538160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:2.0:1787118759.538178:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+42:10432:x1873929544174080:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118759.538199:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.538217:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9c0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.538315:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.538328:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 43 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.538337:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.538615:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 43 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.538649:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 43 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.538663:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566226304:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118759.538780:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118759.551156:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118759.551252:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174208 00000100:00100000:1.0:1787118759.551261:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174208 00010000:00010000:1.0:1787118759.551302:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 44 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118759.551343:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:1.0:1787118759.551352:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+44:2368:x1873929544174208:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118759.551367:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118759.551375:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 44 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.551388:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 44 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.551428:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118759.551433:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.551442:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.551449:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.551469:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118759.551525:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+44:2368:x1873929544174208:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 173us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118759.551533:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 40 00010000:00010000:2.0:1787118759.551839:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9b2 expref: 43 pid: 7892 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.551855:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566226304:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118759.551876:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.551884:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.551889:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.551906:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787118759.552054:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.552068:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.552076:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.552087:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118759.552090:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118759.552138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+43:10432:x1873929544174080:12345-192.168.203.10@tcp:101:bash.0 Request processed in 13962us (14142us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787118759.552146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:0.0:1787118759.559557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.559906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174464 00000100:00100000:2.0:1787118759.559916:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174464 00000100:00100000:2.0:1787118759.560013:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 58 00000100:00100000:2.0:1787118759.560024:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+43:10432:x1873929544174464:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:2.0:1787118759.560302:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.560319:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.560330:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118759.560403:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787118759.560456:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd9f7f2 reply state 00000000a4e8bb13 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.560466:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118759.560553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+46:10432:x1873929544174464:12345-192.168.203.10@tcp:36:bash.0 Request processed in 531us (1003us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787118759.560561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 58 00000020:00080000:2.0:1787118759.560566:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787118759.564473:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564490:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564497:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564502:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118759.564506:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564514:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564546:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118759.564549:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118759.564554:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.564560:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f89da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118759.575830:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.575993:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174592 00000100:00100000:2.0:1787118759.576003:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174592 00000100:00100000:2.0:1787118759.576065:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:2.0:1787118759.576097:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+45:10432:x1873929544174592:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118759.576129:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.576161:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9c7 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.576244:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.576258:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.576265:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.576299:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.576312:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 46 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.576327:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566226432:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118759.576412:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787118759.581836:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118759.582901:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174720 00000100:00100000:1.0:1787118759.582912:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174720 00010000:00010000:1.0:1787118759.582955:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 47 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118759.583002:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:1.0:1787118759.583012:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+47:2369:x1873929544174720:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118759.583027:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118759.583034:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 47 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.583047:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 47 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.583078:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118759.583083:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.583092:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.583125:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118759.583145:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118759.583463:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+47:2369:x1873929544174720:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 452us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118759.583471:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00010000:00010000:2.0:1787118759.583652:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c0 expref: 46 pid: 5841 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.583680:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375beb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566226432:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118759.583701:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.583768:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.583893:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.583938:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787118759.583942:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118759.583961:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.583992:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f89e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c7 expref: 46 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.584006:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c7 expref: 45 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.584015:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.584018:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118759.584020:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987a00, rc 0) 00000100:00100000:2.0:1787118759.584048:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+45:10432:x1873929544174592:12345-192.168.203.10@tcp:101:bash.0 Request processed in 7953us (8229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118759.584055:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:1.0:1787118759.593598:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118759.593816:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544174976 00000100:00100000:3.0:1787118759.593826:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544174976 00000100:00100000:3.0:1787118759.593881:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118759.593891:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+45:10432:x1873929544174976:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:3.0:1787118759.594125:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:10432:x1873929544174976:12345-192.168.203.10@tcp:35:bash.0 Request processed in 235us (534us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787118759.594133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:0.0:1787118759.647290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118759.647328:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118759.647363:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.647454:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544175232 00000100:00100000:2.0:1787118759.647463:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544175232 00000100:00100000:2.0:1787118759.647533:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:2.0:1787118759.647544:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544175232:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118759.647627:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544175232:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118759.647647:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:3.0:1787118759.647973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544175360 00000100:00100000:3.0:1787118759.647979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544175360 00000100:00100000:3.0:1787118759.648019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 140 00000100:00100000:3.0:1787118759.648026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544175360:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118759.648064:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544175360:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 38us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118759.648071:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 140 00000100:00100000:1.0:1787118759.648343:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544175104 00000100:00100000:1.0:1787118759.648348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544175104 00000100:00100000:1.0:1787118759.648387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 293 00000100:00100000:1.0:1787118759.648395:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544175104:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118759.648422:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544175104:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 30us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118759.648429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 293 00000100:00080000:0.0:1787118759.648582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787118759.648587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787118759.689961:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118759.714912:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.717716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544175616 00000100:00100000:2.0:1787118759.717742:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544175616 00000100:00100000:2.0:1787118759.718492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:2.0:1787118759.718505:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+46:10442:x1873929544175616:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118759.718530:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.718551:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9ce expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.718674:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787118759.718841:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ce expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.718854:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:2.0:1787118759.718857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118759.718861:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f89ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ce expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.718877:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118759.718946:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+47:10442:x1873929544175616:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 444us (4043us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787118759.718954:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:1.0:1787118759.726873:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118759.740761:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544175744 00000100:00100000:0.0:1787118759.740776:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544175744 00000100:00100000:0.0:1787118759.740978:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:0.0:1787118759.740991:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+47:10442:x1873929544175744:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:0.0:1787118759.741083:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741100:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741123:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741139:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741145:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741161:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741255:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741263:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741271:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118759.741314:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741325:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741340:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741346:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741352:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118759.741356:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741362:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741374:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:0.0:1787118759.741376:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118759.741381:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741386:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f89fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741400:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741407:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741412:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741417:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118759.741428:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741434:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741442:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff961351704300) 00010000:00010000:0.0:1787118759.741444:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118759.741446:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741452:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741468:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741473:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741478:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741482:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118759.741484:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741489:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741495:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:0.0:1787118759.741497:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118759.741507:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.741512:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118759.741591:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+47:10442:x1873929544175744:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 602us (14726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118759.741599:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:1.0:1787118759.749685:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.750081:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544176000 00000100:00100000:2.0:1787118759.750090:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544176000 00000100:00100000:3.0:1787118759.750567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:3.0:1787118759.750579:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+47:10442:x1873929544176000:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118759.750993:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+48:10442:x1873929544176000:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 415us (1316us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787118759.751002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:0.0:1787118759.821428:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.821562:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544176256 00000100:00100000:2.0:1787118759.821626:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544176256 00000100:00100000:2.0:1787118759.821816:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:2.0:1787118759.821826:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+48:10445:x1873929544176256:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118759.821849:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118759.821869:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9d5 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.821964:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.821979:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.821990:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822006:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822013:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822019:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822341:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822350:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822357:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118759.822389:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787118759.822480:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822487:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822493:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822512:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118759.822516:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822524:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822536:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118759.822539:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118759.822543:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822550:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822562:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822568:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822593:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822598:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118759.822601:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822607:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822614:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94c00) 00010000:00010000:2.0:1787118759.822616:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118759.822619:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822625:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822681:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9d5 expref: 51 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822694:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9d5 expref: 50 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.822701:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:2.0:1787118759.822703:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118759.822706:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118759.822817:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+50:10445:x1873929544176256:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 991us (1398us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787118759.822835:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:1.0:1787118759.831475:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118759.831533:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118759.831635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544176512 00000100:00100000:0.0:1787118759.831643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544176512 00000100:00100000:0.0:1787118759.831707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:0.0:1787118759.831718:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+50:10445:x1873929544176512:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118759.831817:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.831834:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.831835:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544176384 00000100:00100000:2.0:1787118759.831843:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544176384 00010000:00010000:0.0:1787118759.831850:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.831878:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.831885:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118759.831891:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.831896:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:2.0:1787118759.831908:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+51:2369:x1873929544176384:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118759.831920:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118759.831922:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118759.831928:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.832054:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9d5 expref: 51 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.836496:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:0.0:1787118759.836497:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118759.836509:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118759.836523:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:0.0:1787118759.836527:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118759.836532:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118759.836591:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+50:2369:x1873929544176384:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 4680us (5121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118759.836602:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00010000:00010000:0.0:1787118759.840708:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118759.840838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+49:10445:x1873929544176512:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 9117us (9299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118759.840849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:1.0:1787118759.859905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118759.860005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544176768 00000100:00100000:2.0:1787118759.860015:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544176768 00000100:00100000:2.0:1787118759.860075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:2.0:1787118759.860084:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+49:10445:x1873929544176768:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118759.860321:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+50:10445:x1873929544176768:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 236us (425us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787118759.860329:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:3.0:1787118760.136467:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118760.136571:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177024 00000100:00100000:1.0:1787118760.136581:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177024 00000100:00100000:1.0:1787118760.136656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:1.0:1787118760.136667:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+50:10463:x1873929544177024:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:1.0:1787118760.136691:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118760.136747:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9dc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118760.136865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8a43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118760.136880:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118760.136892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118760.136903:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00080000:0.0:1787118760.137304:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787118760.137394:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9dc expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118760.137420:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8a43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9dc expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118760.137429:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:1.0:1787118760.137432:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787118760.137435:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9400, rc 0) 00000100:00100000:1.0:1787118760.137503:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:10463:x1873929544177024:12345-192.168.203.10@tcp:101:cat.0 Request processed in 838us (1046us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787118760.137511:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:1.0:1787118760.186755:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.186848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177152 00000100:00100000:3.0:1787118760.186858:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177152 00000100:00100000:3.0:1787118760.186917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 65 00000100:00100000:3.0:1787118760.186926:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+52:10464:x1873929544177152:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118760.186949:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118760.186968:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187043:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187061:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187071:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118760.187138:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787118760.187141:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118760.187162:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187186:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9e3 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187234:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9e3 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.187242:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118760.187245:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787118760.187248:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d400, rc 0) 00000100:00100000:3.0:1787118760.187308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+53:10464:x1873929544177152:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 384us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.187316:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 65 00000100:00100000:0.0:1787118760.198761:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118760.198972:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177536 00000100:00100000:2.0:1787118760.198982:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177536 00000100:00100000:2.0:1787118760.199051:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118760.199062:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+53:10464:x1873929544177536:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118760.199413:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+54:10464:x1873929544177536:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 352us (710us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787118760.199421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:1.0:1787118760.202878:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.202970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177664 00000100:00100000:3.0:1787118760.202980:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177664 00000100:00100000:3.0:1787118760.203041:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:3.0:1787118760.203052:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:10464:x1873929544177664:12345-192.168.203.10@tcp:103:lfs.0 00010000:00010000:3.0:1787118760.203068:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787118760.203093:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f89e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9c7 expref: 54 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.203125:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9dc expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.203136:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f88f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b988 expref: 52 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.203144:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94500) 00010000:00010000:3.0:1787118760.203154:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118760.203318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+51:10464:x1873929544177664:12345-192.168.203.10@tcp:103:lfs.0 Request processed in 268us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.203326:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:0.0:1787118760.214012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118760.214303:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177792 00000100:00100000:2.0:1787118760.214313:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177792 00000100:00100000:2.0:1787118760.214414:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 66 00000100:00100000:2.0:1787118760.214435:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+51:10464:x1873929544177792:12345-192.168.203.10@tcp:58:lfs.0 00010000:00010000:2.0:1787118760.214553:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.214569:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.214580:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118760.214895:0:7892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787118760.215126:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787118760.215190:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787118760.217052:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+51:10464:x1873929544177792:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 2603us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118760.217068:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 66 00000100:00100000:0.0:1787118760.262013:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118760.262137:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544177920 00000100:00100000:2.0:1787118760.262147:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544177920 00000100:00100000:2.0:1787118760.262205:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:2.0:1787118760.262215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+51:10466:x1873929544177920:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118760.262234:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118760.262252:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8a66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9ea expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262323:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262338:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262349:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262363:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262370:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262377:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262465:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262474:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262480:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118760.262510:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787118760.262514:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118760.262531:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262563:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262570:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262576:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262582:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118760.262586:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262593:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.262606:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118760.264095:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118760.264119:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264131:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8a6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264150:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264157:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264179:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264185:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118760.264189:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264195:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264208:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94f00) 00010000:00010000:2.0:1787118760.264211:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118760.264214:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264219:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8a74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264264:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8a66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264279:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.264286:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:2.0:1787118760.264288:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118760.264291:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118760.264371:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+52:10466:x1873929544177920:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 2156us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118760.264391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00010000:00010000:3.0:1787118760.714819:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118760.778083:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566226816:0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.778254:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566226560:0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.778289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118760.778336:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566227072:0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.778376:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566226560 00000100:00100000:1.0:1787118760.778384:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566226560 00000100:00100000:1.0:1787118760.778427:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787118760.778436:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566226560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.778486:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566226560:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118760.778493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787118760.778580:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566226944:0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.778615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118760.778757:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566226944 00000100:00100000:1.0:1787118760.778762:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566226944 00000100:00100000:1.0:1787118760.778811:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787118760.778819:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566226944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.778856:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566226944:12345-0@lo:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118760.778863:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787118760.778899:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566226944:0@lo:400:kworker.0 00000100:00080000:2.0:1787118760.779077:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118760.779128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118760.779249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118760.779286:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787118760.779293:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566226688:0@lo:400:kworker.0 00000100:00100000:1.0:1787118760.779350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566226816 00000100:00100000:1.0:1787118760.779355:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566226816 00000100:00100000:1.0:1787118760.779385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566227072 00000100:00100000:1.0:1787118760.779388:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566227072 00000100:00100000:1.0:1787118760.779410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787118760.779416:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566226816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118760.779789:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787118760.779800:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566227072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.782425:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566226560:0@lo:400:kworker.0 00000100:00100000:0.0:1787118760.784066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118760.784170:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566227200:0@lo:400:kworker.0 00000100:00100000:0.0:1787118760.784227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118760.786600:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566226816:12345-0@lo:400:kworker.0 Request processed in 7175us (8434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118760.786614:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787118760.786648:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566226688 00000100:00100000:1.0:1787118760.786656:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566226688 00000100:00100000:2.0:1787118760.787951:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787118760.787966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566226688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.788039:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566226688:12345-0@lo:400:kworker.0 Request processed in 78us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118760.788046:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787118760.788073:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566227200 00000100:00100000:2.0:1787118760.788078:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566227200 00000100:00100000:2.0:1787118760.788125:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787118760.788132:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.789697:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566227200:12345-0@lo:400:kworker.0 Request processed in 1560us (5463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118760.789709:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787118760.791617:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787118760.791642:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118760.792682:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566227072:12345-0@lo:400:kworker.0 Request processed in 12877us (13425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.792695:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787118760.793849:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566227072:0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.799992:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566226688:0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.800011:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566227200:0@lo:400:kworker.0 00000100:00100000:2.0:1787118760.800022:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566226816:0@lo:400:kworker.0 00000040:00080000:2.0:1787118760.906829:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118760.906836:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787118760.906889:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787118760.906900:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787118760.907024:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566227328:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787118760.907131:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118760.911126:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566227328:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787118760.913357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118760.913525:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178048 00000100:00100000:2.0:1787118760.913533:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178048 00000100:00100000:2.0:1787118760.913593:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:2.0:1787118760.913604:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178048:12345-192.168.203.10@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787118760.913686:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178048:12345-192.168.203.10@tcp:900:lhsmtool_posix.0 Request processed in 78us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118760.913694:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:1.0:1787118760.920820:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.921715:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178176 00000100:00100000:3.0:1787118760.921748:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178176 00000100:00100000:3.0:1787118760.921808:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:3.0:1787118760.921818:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178176:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787118760.921916:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787118760.922018:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178176:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 200us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.922026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:1.0:1787118760.930982:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.931141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178304 00000100:00100000:3.0:1787118760.931151:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178304 00000100:00100000:3.0:1787118760.931221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:3.0:1787118760.931231:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178304:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787118760.931313:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931328:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931341:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931580:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931590:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931598:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931622:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931630:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931637:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118760.931672:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787118760.931676:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118760.931687:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931698:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931705:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931712:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931765:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118760.931769:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931777:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931789:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:3.0:1787118760.931792:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118760.931796:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931802:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8a82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931814:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931821:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931827:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931832:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8dc00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118760.931834:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.931840:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932038:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff961359bc8c00) 00010000:00010000:3.0:1787118760.932041:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118760.932044:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8a89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932064:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932070:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932075:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932081:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118760.932084:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932090:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932097:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:3.0:1787118760.932110:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118760.932114:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118760.932119:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8a90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118760.932391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178304:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 Request processed in 1153us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.932401:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:3.0:1787118760.957433:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118760.957544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178560 00000100:00100000:0.0:1787118760.957553:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178560 00000100:00100000:0.0:1787118760.957617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:0.0:1787118760.957627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:10477:x1873929544178560:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118760.957646:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118760.957664:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8a97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9f1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957783:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957808:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957820:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118760.957832:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787118760.957937:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957945:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957952:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957959:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118760.957962:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957983:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.957995:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:0.0:1787118760.957998:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118760.958003:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.958008:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.958049:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8a97 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9f1 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.958058:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:0.0:1787118760.958060:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118760.958064:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8a97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9f1 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118760.958073:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030800, rc 0) 00000100:00100000:0.0:1787118760.958142:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544178560:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 517us (717us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787118760.958149:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:0.0:1787118760.968440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.968509:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178688 00000100:00100000:3.0:1787118760.968518:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178688 00000100:00100000:3.0:1787118760.968581:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:3.0:1787118760.968592:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544178688:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787118760.968637:0:7892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787118760.968808:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544178688:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 208us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118760.968816:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:1.0:1787118760.984350:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118760.984607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544178944 00000100:00100000:2.0:1787118760.984617:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544178944 00000100:00100000:2.0:1787118760.984676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:2.0:1787118760.984685:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544178944:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118760.984704:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118760.984706:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787118760.984763:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9e3 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.984779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118760.984783:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118760.984795:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8aac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9f8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787118760.985212:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787118760.987868:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.987887:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.987898:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.987960:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8aac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9f8 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.987977:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9f8 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.987985:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118760.987988:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118760.987991:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118760.988074:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:10477:x1873929544178944:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 3390us (3742us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787118760.988082:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:1.0:1787118760.995612:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118760.995978:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179200 00000100:00100000:3.0:1787118760.995988:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179200 00000100:00100000:2.0:1787118760.996289:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 73 00000100:00100000:2.0:1787118760.996300:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+54:10477:x1873929544179200:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787118760.996359:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118760.996403:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9f8 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996420:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118760.996444:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118760.996467:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996480:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996490:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996505:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996512:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996518:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996604:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996612:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996619:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996625:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118760.996629:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996637:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996653:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118760.996656:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118760.996660:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996666:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ac1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996675:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996681:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996686:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996690:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118760.996693:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996698:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996704:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x80a1a4dd (ffff96134bc94300) 00010000:00010000:2.0:1787118760.996707:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118760.996709:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118760.996715:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8ac8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80a1a4dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118760.997044:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544179200:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 744us (1439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787118760.997052:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 73 00000100:00100000:1.0:1787118761.003170:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.003306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179328 00000100:00100000:3.0:1787118761.003316:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179328 00000100:00100000:3.0:1787118761.003381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00100000:3.0:1787118761.003399:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+53:10477:x1873929544179328:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.003418:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118761.003439:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8acf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2b9ff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003470:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003481:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003505:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003600:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003616:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.003625:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:3.0:1787118761.003628:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787118761.003631:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118761.003686:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+54:10477:x1873929544179328:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 289us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.003693:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00100000:1.0:1787118761.009949:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.010436:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179584 00000100:00100000:0.0:1787118761.010445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179584 00000100:00100000:0.0:1787118761.010501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 75 00000100:00100000:0.0:1787118761.010510:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+54:10477:x1873929544179584:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787118761.010608:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.010625:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.010634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787118761.011422:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787118761.011435:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340168712066ns, next at 341168709153ns, rc = 0 00000004:00010000:1.0:1787118761.011529:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc6825a7 reply state 0000000018261cb9 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.011538:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118761.011656:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+56:10477:x1873929544179584:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 1145us (1714us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787118761.011664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 75 00010000:00010000:2.0:1787118761.014913:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014930:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014938:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014944:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118761.014949:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014956:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014971:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:2.0:1787118761.014974:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787118761.014977:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.014983:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8add lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.018237:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.020656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179712 00000100:00100000:3.0:1787118761.020670:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179712 00000100:00100000:3.0:1787118761.021980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:3.0:1787118761.022015:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:10477:x1873929544179712:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.022041:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118761.022075:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba06 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.022148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.022287:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.022323:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:3.0:1787118761.022326:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787118761.022330:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c600, rc 0) 00000100:00100000:3.0:1787118761.022607:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+56:10477:x1873929544179712:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 600us (4378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.022615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:1.0:1787118761.035074:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118761.036130:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179840 00000100:00100000:2.0:1787118761.036142:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179840 00000100:00100000:2.0:1787118761.036192:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:2.0:1787118761.036214:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1873929544179840:12345-192.168.203.10@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787118761.036245:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:2.0:1787118761.036275:0:6704:0:(genops.c:1406:class_connect()) connect: client 4b9d85e8-2500-4b81-a525-0303ce911299, cookie 0xaa534e3c784f8aeb 00002000:00100000:2.0:1787118761.036286:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4b9d85e8-2500-4b81-a525-0303ce911299/ffff9613431e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787118761.036309:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787118761.036932:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787118761.036964:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9613431e7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118761.037205:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2367:x1873929544179840:12345-192.168.203.10@tcp:8:lhsmtool_posix.0 Request processed in 989us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118761.037214:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:1.0:1787118761.084881:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.085328:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544179968 00000100:00100000:0.0:1787118761.085337:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544179968 00000100:00080000:1.0:1787118761.085428:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118761.086930:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:0.0:1787118761.086944:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:0:x1873929544179968:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1787118761.168166:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787118761.168186:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000100:00100000:1.0:1787118761.172705:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:0:x1873929544179968:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 85755us (87822us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787118761.172718:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:2.0:1787118761.191856:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.193012:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544180224 00000100:00100000:0.0:1787118761.193024:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544180224 00000100:00100000:0.0:1787118761.193079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:0.0:1787118761.193088:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+56:10477:x1873929544180224:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787118761.193334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+57:10477:x1873929544180224:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 246us (1487us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787118761.193352:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:1.0:1787118761.210471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.210600:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544180480 00000100:00100000:3.0:1787118761.210610:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544180480 00000100:00100000:3.0:1787118761.210669:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:3.0:1787118761.210679:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+57:10477:x1873929544180480:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787118761.211150:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+57:10477:x1873929544180480:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 470us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.211158:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:1.0:1787118761.214516:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118761.214801:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544180608 00000100:00100000:2.0:1787118761.214810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544180608 00000100:00100000:2.0:1787118761.214878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 78 00000100:00100000:2.0:1787118761.214888:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+57:10477:x1873929544180608:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118761.214909:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118761.214929:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba0d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.214997:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.215011:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.215021:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118761.215065:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118761.215082:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.215122:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba0d expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.215137:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba0d expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.215144:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:2.0:1787118761.215147:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118761.215151:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118761.215201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+58:10477:x1873929544180608:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 315us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118761.215208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 78 00000100:00100000:1.0:1787118761.224669:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.224990:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544180736 00000100:00100000:0.0:1787118761.225000:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544180736 00000100:00100000:0.0:1787118761.225256:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:0.0:1787118761.225267:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544180736:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118761.225287:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118761.226031:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba14 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118761.226237:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8544a8, blocks: 0x1 00010000:00010000:0.0:1787118761.226259:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1787118761.226264:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118761.226275:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.226297:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.226310:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030800, rc 0) 00000100:00100000:0.0:1787118761.226547:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544180736:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 1281us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.226556:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:2.0:1787118761.243975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.244983:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544180992 00000100:00100000:3.0:1787118761.244995:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544180992 00000100:00100000:3.0:1787118761.245269:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:3.0:1787118761.245281:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+58:10477:x1873929544180992:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787118761.245535:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+58:10477:x1873929544180992:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 255us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.245544:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:1.0:1787118761.250052:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.250144:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181120 00000100:00100000:3.0:1787118761.250163:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181120 00000100:00100000:3.0:1787118761.250219:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:3.0:1787118761.250230:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:10477:x1873929544181120:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.250263:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118761.250282:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba1b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.250312:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.250321:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118761.250325:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118761.250330:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.250362:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.250375:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.250400:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566227456:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118761.250494:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992900 going to sleep for 11 seconds 00000100:00100000:3.0:1787118761.255499:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566227456:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118761.255535:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.255557:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118761.256129:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:10477:x1873929544181120:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 5901us (6086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.256138:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:2.0:1787118761.263710:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118761.264390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181248 00000100:00100000:1.0:1787118761.264401:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181248 00010000:00010000:1.0:1787118761.264440:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.264516:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:1.0:1787118761.264527:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350045850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544181248:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118761.264540:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118761.264573:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.264589:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.264611:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f8b00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba14 expref: 7 pid: 8419 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.264628:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118761.264632:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118761.264640:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.264649:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.264710:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.265037:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1873929566227584:192.168.203.10@tcp:105: 00000100:00100000:1.0:1787118761.265132:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136989c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118761.276214:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118761.276317:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1873929566227584:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118761.276341:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118761.276395:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350045850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544181248:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 11870us (12693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118761.276406:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:3.0:1787118761.278847:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181376 00000100:00100000:3.0:1787118761.278862:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181376 00002000:00100000:3.0:1787118761.278913:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9613476ca680 x1873929544181376/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:552/0 lens 504/0 e 0 to 0 dl 1787118772 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118761.278925:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9613476ca680 with x1873929544181376 ext(0->8) 00002000:00010000:3.0:1787118761.278932:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9613476ca680 00000100:00100000:3.0:1787118761.278970:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118761.278980:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544181376:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787118761.280439:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544181376:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 Request processed in 1455us (4229us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787118761.280451:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00002000:00100000:3.0:1787118761.280460:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9613476ca680 x1873929544181376/t4294967302(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:552/0 lens 504/448 e 0 to 0 dl 1787118772 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118761.280469:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9613476ca680 with x1873929544181376 ext(0->8) 00002000:00010000:3.0:1787118761.280474:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9613476ca680 00000100:00100000:2.0:1787118761.291757:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118761.291797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181504 00000100:00100000:2.0:1787118761.291806:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181504 00000100:00100000:2.0:1787118761.291864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 80 00000100:00100000:2.0:1787118761.291873:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+58:10477:x1873929544181504:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 00000004:00080000:0.0:1787118761.292141:0:7938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340449417958ns, next at 341449415567ns, rc = 0 00000100:00100000:0.0:1787118761.292180:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566227712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118761.292294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118761.296389:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566227712 00000100:00100000:3.0:1787118761.296402:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566227712 00000100:00100000:3.0:1787118761.296506:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787118761.296516:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566227712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118761.296587:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118761.296699:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566227712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (4403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.296793:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787118761.296849:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566227712:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787118761.303768:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118761.303778:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787118761.303824:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787118761.303830:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787118761.374759:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+58:10477:x1873929544181504:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 Request processed in 82843us (82967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118761.374772:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 80 00000004:00080000:3.0:1787118761.375550:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787118761.375874:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787118761.375892:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1787118761.375945:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787118761.376251:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118761.376510:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566227840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787118761.376579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118761.376676:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566227840 00000100:00100000:1.0:1787118761.376683:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566227840 00000100:00100000:1.0:1787118761.376766:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787118761.376776:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566227840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787118761.376799:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787118761.376829:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8544a4, atime: 0x6a8544a4, ctime: 0x6a8544a4, blocks: 0x1 00010000:00010000:1.0:1787118761.376838:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.376854:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1787118761.376858:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118761.376865:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.376879:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.376900:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.376907:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.376924:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787118761.377446:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566227840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 670us (865us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787118761.377454:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787118761.377478:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118761.377484:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.377492:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118761.377496:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.377504:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.377521:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.377528:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f8b0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.377551:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118761.377553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118761.377554:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787118761.377585:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96136ebdbb80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787118761.377590:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566227840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787118761.380715:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118761.380761:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566227968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787118761.380834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118761.381263:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566227968 00000100:00100000:2.0:1787118761.381270:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566227968 00000100:00100000:2.0:1787118761.381332:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787118761.381340:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566227968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787118761.381504:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787118761.381507:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787118760 00002000:00010000:2.0:1787118761.381510:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787118761.381512:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787118760 -> 1787118760 00002000:00010000:2.0:1787118761.381514:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787118761.381558:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566227968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (725us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787118761.381577:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1787118761.381936:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9613476cb480/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787118761.381943:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613476cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566227968:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787118761.384557:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9613431b56c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787118761.384577:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961347c97800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9613431b5840 00000020:00080000:3.0:1787118761.384580:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961347c97e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961375c12000 00000020:00080000:3.0:1787118761.384750:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787118761.384873:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787118761.392239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118761.392369:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181632 00000100:00100000:2.0:1787118761.392380:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181632 00000100:00100000:2.0:1787118761.392471:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:2.0:1787118761.392481:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613508f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544181632:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787118761.430042:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787118761.430239:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613508f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544181632:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 Request processed in 37751us (38003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118761.430251:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 30 00000001:00080000:0.0:1787118761.433034:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1787118761.434651:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.435243:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544181888 00000100:00100000:3.0:1787118761.435254:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544181888 00000100:00100000:3.0:1787118761.435333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:3.0:1787118761.435344:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:10477:x1873929544181888:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.435394:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118761.435421:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba0d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.435439:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:3.0:1787118761.435443:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118761.435473:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.435488:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.435515:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787118761.436047:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d43d6c7 reply state 00000000177c8502 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.436057:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787118761.436276:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:10477:x1873929544181888:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 932us (1631us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787118761.436283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 81 00010000:00010000:0.0:1787118761.438798:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438813:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438820:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438834:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118761.438839:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438846:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438862:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:0.0:1787118761.438865:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118761.438869:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.438875:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118761.443987:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.444050:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182016 00000100:00100000:3.0:1787118761.444059:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182016 00000100:00100000:3.0:1787118761.444122:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:3.0:1787118761.444133:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544182016:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787118761.444524:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787118761.444528:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787118760 -> 1787118758 00002000:00010000:3.0:1787118761.444530:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787118756 00002000:00010000:3.0:1787118761.444532:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787118760 -> 1787118758 00002000:00010000:3.0:1787118761.444534:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787118761.444595:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544182016:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 464us (808us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787118761.444603:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:2.0:1787118761.447034:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.447317:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182272 00000100:00100000:3.0:1787118761.447326:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182272 00000100:00100000:3.0:1787118761.447566:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:3.0:1787118761.447578:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:10477:x1873929544182272:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.447657:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.447685:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.447778:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.447823:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.447836:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 13 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.447849:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566228096:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118761.448011:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992180 going to sleep for 11 seconds 00000100:00100000:0.0:1787118761.451453:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.451489:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182400 00000100:00100000:0.0:1787118761.451499:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182400 00010000:00010000:0.0:1787118761.451536:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.451577:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:0.0:1787118761.451587:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544182400:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118761.451602:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118761.451609:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.451622:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.451663:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:0.0:1787118761.451668:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.451678:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.451685:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.451703:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118761.451776:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544182400:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 189us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.451783:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 43 00010000:00010000:3.0:1787118761.452406:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8ad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ff expref: 13 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.452425:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566228096:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118761.452451:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452460:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452466:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452506:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452513:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452531:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452539:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118761.452544:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452551:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452563:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:3.0:1787118761.452566:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787118761.452570:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.452576:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.453153:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+12:10477:x1873929544182272:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 Request processed in 5575us (6124us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787118761.453163:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:0.0:1787118761.460292:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118761.460402:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182528 00000100:00100000:1.0:1787118761.460411:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182528 00000100:00100000:1.0:1787118761.460475:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:1.0:1787118761.460484:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544182528:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787118761.460528:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.460547:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.460556:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118761.460559:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118761.460564:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.460617:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.460630:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 7 pid: 6703 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.460643:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8419:1873929566228224:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118761.460758:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118761.464047:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8419:1873929566228224:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118761.464088:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.464694:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118761.465163:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182656 00000100:00100000:1.0:1787118761.465171:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182656 00010000:00010000:1.0:1787118761.465211:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 8 pid: 6703 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.465385:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:1.0:1787118761.465396:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544182656:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118761.465411:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118761.465435:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 8 pid: 6703 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.465448:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 8 pid: 6703 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.465470:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac996de/0xaa534e3c784f8b07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba1b expref: 8 pid: 6703 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.465503:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118761.465507:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118761.465511:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.465520:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.465551:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118761.465602:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544182656:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 207us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118761.465610:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 44 00010000:00010000:0.0:1787118761.465700:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465709:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465748:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465761:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465769:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465776:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118761.465779:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465787:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465797:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.465804:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f42c708/0xaa534e3c784f8b23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.465852:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544182528:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 Request processed in 5370us (5570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.465859:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:2.0:1787118761.473573:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118761.473697:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544182912 00000100:00100000:3.0:1787118761.473707:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544182912 00000100:00100000:3.0:1787118761.473778:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 83 00000100:00100000:3.0:1787118761.473798:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+12:10477:x1873929544182912:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787118761.473880:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.473899:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.473910:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.474206:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.474217:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.474226:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.474257:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.474270:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 13 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118761.474284:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566228352:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118761.474377:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992180 going to sleep for 11 seconds 00000100:00100000:3.0:1787118761.479322:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566228352:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118761.479355:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118761.480539:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.480611:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544183040 00000100:00100000:0.0:1787118761.480618:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544183040 00010000:00010000:0.0:1787118761.480663:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.481275:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:0.0:1787118761.481288:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544183040:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118761.481304:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118761.481313:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481328:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481359:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8ae4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba06 expref: 14 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481528:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:0.0:1787118761.481534:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481544:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481552:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.481613:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118761.481752:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+13:2368:x1873929544183040:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 466us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.481760:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00010000:00010000:2.0:1787118761.481944:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118761.481953:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118761.482145:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787118761.482291:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787118761.482350:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787118761.482438:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96134649ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566228480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787118761.482491:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118761.482529:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787118761.482907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566228480 00000100:00100000:0.0:1787118761.482923:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566228480 00000100:00100000:0.0:1787118761.482966:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118761.482975:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7892:x1873929566228480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787118761.483060:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7892:x1873929566228480:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.483068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118761.483114:0:7892:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787118761.483120:0:7892:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9613476cb480, transno 4294967303 00000100:00100000:0.0:1787118761.483131:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96134649ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566228480:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787118761.483646:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787118761.483971:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566228608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787118761.484021:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118761.484043:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff961343c34b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118761.484061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566228608 00000100:00100000:0.0:1787118761.484065:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566228608 00000100:00100000:0.0:1787118761.484089:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118761.484106:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7892:x1873929566228608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787118761.484259:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566228608:12345-0@lo:1000:mdt00_003.0 Request processed in 164us (238us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787118761.484267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118761.484302:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566228608:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787118761.484331:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484340:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484347:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484372:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8dc00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118761.484378:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484385:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484401:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:0.0:1787118761.484404:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118761.484408:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484414:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484451:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484458:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484463:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484467:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118761.484470:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484475:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484494:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:0.0:1787118761.484496:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118761.484499:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484504:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8a5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484525:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484538:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484547:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484570:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.484584:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 16 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.484596:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566228736:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118761.484649:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134149e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118761.492243:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566228736:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118761.492271:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118761.493439:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118761.493605:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544183168 00000100:00100000:0.0:1787118761.493612:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544183168 00010000:00010000:0.0:1787118761.493647:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 17 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.493700:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:0.0:1787118761.493710:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+17:2369:x1873929544183168:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118761.493749:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118761.493757:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 17 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493770:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 17 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493791:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b9ea expref: 17 pid: 5841 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493804:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:0.0:1787118761.493808:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493816:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493825:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493852:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118761.493905:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+16:2369:x1873929544183168:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 196us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118761.493913:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00010000:00010000:0.0:1787118761.493938:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493951:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493962:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493969:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493976:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493981:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118761.493985:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.493993:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494002:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:0.0:1787118761.494005:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118761.494008:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494014:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8b38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494025:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494031:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494042:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494047:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118761.494050:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494376:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494385:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94c00) 00010000:00010000:0.0:1787118761.494387:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787118761.494390:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118761.494396:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118761.494696:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+15:10477:x1873929544182912:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 20895us (21126us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787118761.494706:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 83 00000020:00080000:0.0:1787118761.494710:0:7892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787118761.497993:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118761.501344:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544183424 00000100:00100000:1.0:1787118761.501359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544183424 00000100:00100000:1.0:1787118761.501429:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:1.0:1787118761.501440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:10477:x1873929544183424:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787118761.502092:0:5844:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787118761.502213:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787118761.502259:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502275:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502287:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502307:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502314:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502320:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118761.502348:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118761.502413:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118761.502421:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.502438:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+17:10477:x1873929544183424:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 997us (4452us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1787118761.502440:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118761.502447:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118761.502454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00010000:00010000:3.0:1787118761.502460:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787118761.502462:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787118761.502477:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96136106b300) 00010000:00010000:3.0:1787118761.502481:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787118761.502486:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.502493:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118761.502511:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118761.502513:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118761.502516:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787118761.503995:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118761.504003:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787118761.504038:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787118761.504043:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787118761.738321:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118761.802127:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787118761.802150:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566228864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118761.802218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118761.803838:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566228864 00000100:00100000:3.0:1787118761.803850:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566228864 00000100:00100000:3.0:1787118761.803921:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787118761.803932:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566228864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118761.803958:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787118761.804047:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566228864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118761.804068:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118761.804270:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566228864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787118762.762288:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787118762.935193:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1787118762.935207:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787118762.935389:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000040:00080000:1.0:1787118763.584065:0:12068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118763.584074:0:12068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118763.584128:0:12068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787118763.584134:0:12068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118763.787411:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118763.787509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544183680 00000100:00100000:2.0:1787118763.787523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544183680 00000100:00100000:2.0:1787118763.787619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 84 00000100:00100000:2.0:1787118763.787636:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+17:10496:x1873929544183680:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118763.787659:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118763.787679:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8b46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.787948:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8b4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.787962:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.787976:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118763.787989:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787118763.788173:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba22 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.788188:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba22 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.788197:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118763.788200:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118763.788203:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987000, rc 0) 00000100:00100000:2.0:1787118763.788258:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:10496:x1873929544183680:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 625us (857us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787118763.788265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 84 00000100:00080000:1.0:1787118763.788649:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787118763.791097:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118763.797288:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118763.797381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544183808 00000100:00100000:2.0:1787118763.797391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544183808 00000100:00100000:2.0:1787118763.797446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:2.0:1787118763.797456:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:10496:x1873929544183808:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:2.0:1787118763.797531:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797559:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797570:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797584:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797598:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797890:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797898:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118763.797939:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797951:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797964:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797970:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.797976:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118763.797981:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798004:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798015:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118763.798018:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118763.798021:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798026:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8b5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798038:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798043:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798048:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798054:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118763.798062:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798067:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798074:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94300) 00010000:00010000:2.0:1787118763.798077:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118763.798079:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798095:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798107:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798112:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798117:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798121:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118763.798123:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798128:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798135:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118763.798136:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118763.798145:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.798151:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118763.798230:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:10496:x1873929544183808:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 775us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118763.798238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:3.0:1787118763.884576:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118763.884830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544184064 00000100:00100000:3.0:1787118763.884839:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544184064 00000100:00100000:3.0:1787118763.884893:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:3.0:1787118763.884904:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:10499:x1873929544184064:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118763.884921:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118763.884942:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8b70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba29 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885010:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885025:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885039:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885060:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.885066:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.886490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.886511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.886522:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118763.886537:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787118763.887018:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887028:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887034:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887041:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118763.887045:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887052:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887064:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118763.887068:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118763.887072:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887078:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887100:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887114:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887119:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887124:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118763.887127:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887134:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887141:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff961359bc8d00) 00010000:00010000:3.0:1787118763.887144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118763.887146:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887151:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887198:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887289:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118763.887297:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:3.0:1787118763.887299:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118763.887307:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118763.887751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:10499:x1873929544184064:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 2847us (3183us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787118763.887761:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:1.0:1787118763.896139:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118763.896221:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544184192 00000100:00100000:0.0:1787118763.896230:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544184192 00000100:00100000:0.0:1787118763.896288:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00100000:0.0:1787118763.896297:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+21:10499:x1873929544184192:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118763.896373:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896389:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896399:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896423:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896429:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896436:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896441:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118763.896445:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896452:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896462:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:0.0:1787118763.896465:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118763.896469:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.896475:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118763.896570:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+21:10499:x1873929544184192:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 274us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118763.896783:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00100000:3.0:1787118763.902502:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118763.902695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544184448 00000100:00100000:1.0:1787118763.902717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544184448 00000100:00100000:1.0:1787118763.902806:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:1.0:1787118763.902816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+21:10499:x1873929544184448:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118763.903059:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:10499:x1873929544184448:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 243us (564us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787118763.903067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:3.0:1787118763.968566:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118763.968657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544184704 00000100:00100000:1.0:1787118763.968676:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544184704 00000100:00100000:1.0:1787118763.968773:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:1.0:1787118763.968784:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:10019:x1873929544184704:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118763.968808:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118763.968828:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118763.968931:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118763.968945:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118763.968954:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118763.968987:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118763.968998:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 23 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118763.969027:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566228992:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118763.969119:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118763.971866:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566228992:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118763.971894:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118763.974271:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118763.974401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544184832 00000100:00100000:0.0:1787118763.974410:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544184832 00010000:00010000:0.0:1787118763.974463:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 24 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118763.974505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:0.0:1787118763.974515:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+24:2369:x1873929544184832:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118763.974528:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118763.974535:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 24 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974548:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 24 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974570:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba29 expref: 24 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974586:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:0.0:1787118763.974590:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974599:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974623:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.974656:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118763.974703:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+23:2369:x1873929544184832:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 189us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118763.974711:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00010000:00010000:2.0:1787118763.974818:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.974827:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118763.974844:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787118763.974985:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8b9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.974999:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.975007:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:2.0:1787118763.975010:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118763.975012:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8800, rc 0) 00000100:00100000:2.0:1787118763.975035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:10019:x1873929544184704:12345-192.168.203.10@tcp:101:bash.0 Request processed in 6254us (6492us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787118763.975042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:3.0:1787118763.981595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118763.983556:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185088 00000100:00100000:0.0:1787118763.983569:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185088 00000100:00100000:0.0:1787118763.983635:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 89 00000100:00100000:0.0:1787118763.983646:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:10019:x1873929544185088:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:0.0:1787118763.983928:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.983944:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118763.983955:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118763.984004:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787118763.984033:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fce4f789 reply state 00000000131ae969 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118763.984041:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787118763.984102:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787118763.984215:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+27:10019:x1873929544185088:12345-192.168.203.10@tcp:36:bash.0 Request processed in 569us (2626us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787118763.984223:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 89 00000020:00080000:0.0:1787118763.984242:0:7892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787118763.988018:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988052:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988060:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988066:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118763.988072:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988088:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988103:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:2.0:1787118763.988106:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118763.988111:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988118:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8baf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118763.988594:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118763.988651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185216 00000100:00100000:2.0:1787118763.988660:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185216 00000100:00100000:2.0:1787118763.988774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 90 00000100:00100000:2.0:1787118763.988785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+26:10019:x1873929544185216:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118763.988810:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118763.988828:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8bb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba37 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.988883:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba37 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.989204:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba37 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.989227:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:2.0:1787118763.989229:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118763.989233:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118763.989296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:10019:x1873929544185216:12345-192.168.203.10@tcp:101:bash.0 Request processed in 512us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118763.989302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 90 00000100:00100000:3.0:1787118763.992053:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118763.992184:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185344 00000100:00100000:2.0:1787118763.992194:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185344 00000100:00100000:2.0:1787118763.992305:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:2.0:1787118763.992316:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:10019:x1873929544185344:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118763.992332:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118763.992350:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba3e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787118763.992376:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8544a6, atime: 0x6a8544a4, ctime: 0x6a8544a6, blocks: 0xb 00010000:00010000:2.0:1787118763.992395:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1787118763.992400:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118763.992408:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.992437:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118763.992467:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:2.0:1787118763.992517:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:10019:x1873929544185344:12345-192.168.203.10@tcp:101:bash.0 Request processed in 203us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118763.992524:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00080000:1.0:1787118763.995071:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118763.995989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118763.996151:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185472 00000100:00100000:2.0:1787118763.996161:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185472 00002000:00010000:2.0:1787118763.996200:0:6708:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787118763.996205:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e9de680 with x1873929544185472 ext(0->18446744073709551615) 00002000:00010000:2.0:1787118763.996216:0:6708:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e9de680. 00000100:00100000:2.0:1787118763.996248:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:2.0:1787118763.996257:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544185472:12345-192.168.203.10@tcp:10:bash.0 00002000:00010000:2.0:1787118763.996517:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787118763.996521:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787118758 -> 1787118763 00002000:00010000:2.0:1787118763.996524:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787118756 -> 1787118756 00002000:00010000:2.0:1787118763.996526:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787118758 -> 1787118763 00002000:00010000:2.0:1787118763.996527:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787118763.996597:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2371:x1873929544185472:12345-192.168.203.10@tcp:10:bash.0 Request processed in 341us (614us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787118763.996605:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00002000:00010000:2.0:1787118763.996609:0:6708:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787118763.996611:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e9de680 with x1873929544185472 ext(0->18446744073709551615) 00002000:00010000:2.0:1787118763.996615:0:6708:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e9de680. 00000100:00100000:0.0:1787118764.074844:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.074946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185600 00000100:00100000:1.0:1787118764.074957:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185600 00000100:00100000:1.0:1787118764.075016:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:1.0:1787118764.075027:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+27:10513:x1873929544185600:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:1.0:1787118764.075110:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075127:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075137:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075152:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075159:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075166:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075470:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075477:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118764.075513:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075524:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075530:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075537:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075660:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.075666:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075673:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075686:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118764.075689:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.075693:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075705:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8bc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075717:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075952:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075959:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075964:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.075967:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075974:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075983:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96136106bb00) 00010000:00010000:1.0:1787118764.075986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.075989:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.075995:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076015:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076022:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076034:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076039:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.076043:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076049:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076057:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:1.0:1787118764.076060:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.076063:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.076069:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118764.076160:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+27:10513:x1873929544185600:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 1134us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118764.076168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:3.0:1787118764.125308:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.125534:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185856 00000100:00100000:1.0:1787118764.125542:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185856 00000100:00100000:1.0:1787118764.125604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:1.0:1787118764.125614:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+27:10516:x1873929544185856:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118764.125631:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118764.125651:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125774:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125787:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125797:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125810:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125817:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.125824:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126135:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126144:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126151:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118764.126160:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787118764.126445:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126453:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126465:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126471:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.126475:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126482:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126494:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118764.126497:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.126501:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126507:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126517:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126523:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126529:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126534:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.126537:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126550:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126558:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96136106bb00) 00010000:00010000:1.0:1787118764.126560:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.126562:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126568:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126716:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8bd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba45 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126871:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba45 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.126879:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:1.0:1787118764.126881:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787118764.126883:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9600, rc 0) 00000100:00100000:1.0:1787118764.126943:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+29:10516:x1873929544185856:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1324us (1644us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787118764.126952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:2.0:1787118764.139535:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.139627:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544185984 00000100:00100000:0.0:1787118764.139637:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544185984 00000100:00100000:0.0:1787118764.139706:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:0.0:1787118764.139716:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:10516:x1873929544185984:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118764.139979:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.139997:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.140007:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.140041:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.140054:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 29 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.140067:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566229120:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118764.140173:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134313e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118764.147420:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.147530:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566229120:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118764.147569:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.148058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544186240 00000100:00100000:3.0:1787118764.148066:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544186240 00000100:00100000:3.0:1787118764.148139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:3.0:1787118764.148149:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+30:9983:x1873929544186240:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787118764.149633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+31:9983:x1873929544186240:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 1478us (2214us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787118764.149652:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:3.0:1787118764.158351:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.158461:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544186368 00000100:00100000:0.0:1787118764.158471:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544186368 00010000:00010000:0.0:1787118764.158682:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 31 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.158859:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:0.0:1787118764.158872:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+31:2368:x1873929544186368:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118764.158887:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118764.158895:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 31 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158909:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 31 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158931:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8ba1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba30 expref: 31 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158949:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:0.0:1787118764.158955:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158964:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158971:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.158993:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118764.159049:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+30:2368:x1873929544186368:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 180us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118764.159057:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 48 00010000:00010000:1.0:1787118764.159279:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159296:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159328:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159335:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159342:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159347:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.159352:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159358:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159368:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:1.0:1787118764.159370:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118764.159373:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.159379:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118764.159435:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:10516:x1873929544185984:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 19718us (19907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118764.159444:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:3.0:1787118764.163027:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.168803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544186624 00000100:00100000:0.0:1787118764.168833:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544186624 00000100:00100000:0.0:1787118764.168949:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:0.0:1787118764.168960:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+29:10516:x1873929544186624:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118764.169230:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+30:10516:x1873929544186624:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 271us (6511us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787118764.169239:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:2.0:1787118764.316941:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.317114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544186880 00000100:00100000:3.0:1787118764.317123:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544186880 00000100:00100000:3.0:1787118764.317189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 94 00000100:00100000:3.0:1787118764.317199:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+30:10527:x1873929544186880:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:3.0:1787118764.317221:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118764.317240:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8c03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba4c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317311:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317324:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317335:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317348:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317355:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317361:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317940:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317952:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.317960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118764.317971:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787118764.318062:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318070:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318101:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318107:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118764.318112:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318120:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318132:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118764.318135:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118764.318139:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318145:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8c0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318159:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318165:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318170:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318174:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118764.318177:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318193:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318201:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff961359bc8d00) 00010000:00010000:3.0:1787118764.318203:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118764.318206:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318257:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8c03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba4c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318271:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba4c expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.318279:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:3.0:1787118764.318281:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118764.318283:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d800, rc 0) 00000100:00100000:3.0:1787118764.318658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+32:10527:x1873929544186880:12345-192.168.203.10@tcp:101:cat.0 Request processed in 1458us (1723us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787118764.318666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 94 00000100:00100000:1.0:1787118764.330684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.331578:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544187136 00000100:00100000:3.0:1787118764.331588:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544187136 00000100:00100000:3.0:1787118764.331646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:3.0:1787118764.331655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:10527:x1873929544187136:12345-192.168.203.10@tcp:35:cat.0 00000100:00100000:3.0:1787118764.331922:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:10527:x1873929544187136:12345-192.168.203.10@tcp:35:cat.0 Request processed in 266us (1244us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787118764.331930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:2.0:1787118764.377002:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.377280:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544187392 00000100:00100000:1.0:1787118764.377290:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544187392 00000100:00100000:1.0:1787118764.377351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 95 00000100:00100000:1.0:1787118764.377361:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+33:10528:x1873929544187392:12345-192.168.203.10@tcp:36:rm.0 00010000:00010000:1.0:1787118764.377419:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787118764.377445:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba4c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377472:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba45 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba37 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff961359bc8100) 00010000:00010000:1.0:1787118764.377506:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118764.377525:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377537:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377559:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377573:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.377602:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.378122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.378141:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.378151:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787118764.379021:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787118764.379033:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343536310131ns, next at 344536307499ns, rc = 0 00010000:00010000:1.0:1787118764.379662:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379685:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379692:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379699:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379705:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379772:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118764.379793:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379799:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379805:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379811:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.379815:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379822:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379832:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96136106b700) 00010000:00010000:1.0:1787118764.379835:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787118764.379838:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379860:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379867:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379872:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379884:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.379887:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379893:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118764.379904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.379907:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.379911:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118764.379922:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037bf30e7 reply state 0000000020e25aa6 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118764.379929:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118764.380026:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:10528:x1873929544187392:12345-192.168.203.10@tcp:36:rm.0 Request processed in 2663us (3029us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787118764.380035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 95 00010000:00010000:0.0:1787118764.380583:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118764.380591:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.380598:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118764.380601:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.380607:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.380616:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96136106b700) 00010000:00010000:0.0:1787118764.380619:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787118764.380621:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.380627:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.380652:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118764.380654:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118764.380655:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118764.385636:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385681:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385689:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385695:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118764.385700:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385708:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385765:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96136106bb00) 00010000:00010000:0.0:1787118764.385770:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118764.385775:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.385781:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.516801:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.516972:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544187648 00000100:00100000:1.0:1787118764.516981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544187648 00000100:00100000:1.0:1787118764.517040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:1.0:1787118764.517050:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+31:10534:x1873929544187648:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118764.517074:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118764.517103:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517261:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517276:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517287:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517302:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517310:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.517317:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787118764.517914:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787118764.518092:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518105:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518113:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518147:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518164:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518171:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518176:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.518181:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518188:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518200:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118764.518203:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.518207:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518213:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118764.518227:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb213ac reply state 00000000fb20336f transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118764.518235:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787118764.518264:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8c42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518278:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.518296:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:1.0:1787118764.518299:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118764.518301:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9c00, rc 0) 00000100:00100000:1.0:1787118764.518375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+34:10534:x1873929544187648:12345-192.168.203.10@tcp:101:bash.0 Request processed in 1326us (1583us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787118764.518383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 96 00010000:00010000:1.0:1787118764.524281:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524300:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524307:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524312:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.524318:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524325:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524341:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96136106be00) 00010000:00010000:1.0:1787118764.524344:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.524349:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.524356:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8c50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.528784:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.529001:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544187776 00000100:00100000:3.0:1787118764.529011:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544187776 00000100:00100000:3.0:1787118764.529101:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:3.0:1787118764.529112:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2370:x1873929544187776:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:3.0:1787118764.529128:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118764.529158:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba5a expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118764.529186:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118764.529205:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787118764.529210:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118764.529219:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.529238:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.529252:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c600, rc 0) 00000100:00100000:3.0:1787118764.529422:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544187776:12345-192.168.203.10@tcp:101:bash.0 Request processed in 311us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118764.529429:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00080000:2.0:1787118764.529773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118764.539036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.539548:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544187904 00000100:00100000:3.0:1787118764.539572:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544187904 00000100:00100000:3.0:1787118764.539629:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:3.0:1787118764.539638:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:10534:x1873929544187904:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:3.0:1787118764.539656:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118764.539675:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba61 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.539711:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.539742:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118764.539748:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118764.539753:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.539787:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.539801:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 7 pid: 6704 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.539816:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566229248:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118764.539921:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118764.544000:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.544249:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544188032 00000100:00100000:0.0:1787118764.544258:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544188032 00010000:00010000:0.0:1787118764.544298:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 8 pid: 6704 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.544346:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:0.0:1787118764.544356:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350047050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544188032:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118764.544372:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118764.544408:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 8 pid: 6704 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.544421:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 8 pid: 6704 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.544444:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118764.544449:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118764.544458:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.544468:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.544503:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.544518:0:8463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1873929566229376:192.168.203.10@tcp:105: 00010000:00010000:3.0:1787118764.544590:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8c65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba5a expref: 8 pid: 6704 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.544603:0:8463:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134313ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787118764.544618:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566229248:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118764.544641:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.544652:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d400, rc 0) 00000100:00100000:3.0:1787118764.544680:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:10534:x1873929544187904:12345-192.168.203.10@tcp:101:bash.0 Request processed in 5043us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118764.544688:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:1.0:1787118764.548159:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.548472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544188288 00000100:00100000:3.0:1787118764.548480:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544188288 00000100:00100000:3.0:1787118764.548536:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:3.0:1787118764.548545:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:10534:x1873929544188288:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:3.0:1787118764.548982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+34:10534:x1873929544188288:12345-192.168.203.10@tcp:35:bash.0 Request processed in 438us (832us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787118764.548990:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:0.0:1787118764.549032:0:8463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1873929566229376:192.168.203.10@tcp:105: 00010000:00010000:0.0:1787118764.549052:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118764.549085:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350047050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544188032:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 4721us (5085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118764.549095:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:2.0:1787118764.736156:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.736316:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544188416 00000100:00100000:0.0:1787118764.736326:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544188416 00000100:00100000:0.0:1787118764.736409:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:0.0:1787118764.736420:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+34:10550:x1873929544188416:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118764.736442:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118764.736463:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8c73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba68 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736531:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736545:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736567:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118764.736625:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787118764.736629:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118764.736652:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736679:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8c73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba68 expref: 36 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736701:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba68 expref: 35 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.736710:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:0.0:1787118764.736713:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118764.736716:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030800, rc 0) 00000100:00100000:0.0:1787118764.736828:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:10550:x1873929544188416:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 410us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118764.736842:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:3.0:1787118764.742470:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.743023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544188672 00000100:00100000:1.0:1787118764.743033:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544188672 00000100:00100000:1.0:1787118764.743417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 98 00000100:00100000:1.0:1787118764.743429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+35:10550:x1873929544188672:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118764.743450:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118764.743470:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.743575:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.743589:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.743600:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118764.743612:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787118764.743754:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba6f expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.743771:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba6f expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.743778:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:1.0:1787118764.743781:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118764.743798:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118764.743867:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+37:10550:x1873929544188672:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 440us (1407us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787118764.743874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 98 00000100:00100000:0.0:1787118764.747896:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.747969:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.748052:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544188928 00000100:00100000:1.0:1787118764.748062:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544188928 00000100:00100000:1.0:1787118764.748123:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 99 00000100:00100000:1.0:1787118764.748312:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+37:10550:x1873929544188928:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118764.748336:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118764.748356:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba76 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.748631:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.748646:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.748658:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118764.748670:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787118764.748824:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba76 expref: 40 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.748842:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba76 expref: 39 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.748850:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:1.0:1787118764.748867:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787118764.748871:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8800, rc 0) 00000100:00100000:1.0:1787118764.748983:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+39:10550:x1873929544188928:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 847us (1093us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787118764.748991:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 99 00000100:00100000:3.0:1787118764.749071:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189056 00000100:00100000:3.0:1787118764.749086:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189056 00000100:00100000:3.0:1787118764.749124:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:3.0:1787118764.749143:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+39:2371:x1873929544189056:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118764.749153:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118764.749167:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba6f expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.749191:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:3.0:1787118764.749195:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118764.749217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+38:2371:x1873929544189056:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 87us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118764.749224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:2.0:1787118764.758284:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.758913:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189184 00000100:00100000:0.0:1787118764.758924:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189184 00000100:00100000:0.0:1787118764.758984:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:0.0:1787118764.758994:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544189184:12345-192.168.203.10@tcp:1:lfs.0 00010000:00010000:0.0:1787118764.759038:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.759058:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.759067:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118764.759072:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118764.759085:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.759119:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118764.759144:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 6 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118764.759160:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566229504:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118764.759410:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134313ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118764.761021:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.761153:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.761190:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118764.761449:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189440 00000100:00100000:2.0:1787118764.761458:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189440 00000100:00100000:2.0:1787118764.761516:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:2.0:1787118764.761526:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544189440:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118764.761602:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544189440:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.761610:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:2.0:1787118764.761636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189568 00000100:00100000:2.0:1787118764.761639:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189568 00000100:00100000:2.0:1787118764.761674:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 144 00000100:00100000:2.0:1787118764.761681:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544189568:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118764.761710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544189568:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.761715:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 144 00000100:00080000:2.0:1787118764.761753:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118764.764766:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189312 00000100:00100000:3.0:1787118764.764780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189312 00000100:00100000:3.0:1787118764.764834:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 295 00000100:00100000:3.0:1787118764.764843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544189312:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118764.764915:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544189312:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 71us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118764.764922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 295 00000100:00100000:2.0:1787118764.765504:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566229504:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118764.765529:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.766490:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.766568:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189696 00000100:00100000:3.0:1787118764.766574:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189696 00002000:00100000:3.0:1787118764.766614:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96137f724a80 x1873929544189696/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:555/0 lens 504/0 e 0 to 0 dl 1787118775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118764.766624:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f724a80 with x1873929544189696 ext(0->8) 00010000:00010000:3.0:1787118764.766631:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 7 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.766645:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 7 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118764.766651:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96137f724a80 00000100:00100000:3.0:1787118764.766679:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:3.0:1787118764.766699:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544189696:12345-192.168.203.10@tcp:4:lfs.0 00000100:00100000:3.0:1787118764.767220:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544189696:12345-192.168.203.10@tcp:4:lfs.0 Request processed in 521us (733us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787118764.767228:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00002000:00100000:3.0:1787118764.767235:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff96137f724a80 x1873929544189696/t4294967302(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:555/0 lens 504/448 e 0 to 0 dl 1787118775 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118764.767243:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f724a80 with x1873929544189696 ext(0->8) 00010000:00010000:3.0:1787118764.767249:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.767260:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118764.767267:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96137f724a80 00000100:00100000:2.0:1787118764.770350:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.770441:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544189824 00000100:00100000:1.0:1787118764.770450:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544189824 00010000:00010000:1.0:1787118764.770490:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118764.770537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:1.0:1787118764.770555:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544189824:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118764.770571:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787118764.770587:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787118764.770590:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787118763 00002000:00010000:1.0:1787118764.770593:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787118763 00002000:00010000:1.0:1787118764.770595:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787118763 00010000:00010000:1.0:1787118764.770601:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.770614:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.770635:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505b8308/0xaa534e3c784f8c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba61 expref: 9 pid: 6703 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.770664:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118764.770668:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118764.770673:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.770683:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.770717:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118764.770802:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544189824:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 256us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118764.770810:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 50 00010000:00010000:3.0:1787118764.771337:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771349:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771375:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771383:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771405:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771412:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118764.771416:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771425:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771439:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.771447:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f8cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.771557:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544189184:12345-192.168.203.10@tcp:1:lfs.0 Request processed in 12563us (13281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118764.771564:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:1.0:1787118764.775451:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118764.775524:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190080 00000100:00100000:3.0:1787118764.775534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190080 00000100:00100000:3.0:1787118764.775593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:3.0:1787118764.775602:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+38:10550:x1873929544190080:12345-192.168.203.10@tcp:35:lfs.0 00000004:00010000:3.0:1787118764.775665:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba76 expref: 38 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787118764.775972:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787118764.776014:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787118764.776466:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787118764.776519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.776535:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.776544:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.776578:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.776593:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.776606:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1873929566229632:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118764.776683:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992480 going to sleep for 11 seconds 00000100:00100000:1.0:1787118764.780699:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118764.780982:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190208 00000100:00100000:2.0:1787118764.780990:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190208 00010000:00010000:2.0:1787118764.781027:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 43 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.781064:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:2.0:1787118764.781073:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+43:2368:x1873929544190208:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118764.781095:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118764.781102:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 43 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.781115:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 43 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.781210:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:2.0:1787118764.781217:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.781226:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.781233:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.781250:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118764.781343:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+43:2368:x1873929544190208:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 271us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.781351:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00010000:00010000:3.0:1787118764.781751:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba53 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.781768:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1873929566229632:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118764.781787:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.781806:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.781812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787118764.781919:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787118764.782104:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787118764.782207:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1873929566229760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787118764.782250:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118764.782285:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118764.782710:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566229760 00000100:00100000:2.0:1787118764.782717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566229760 00000100:00100000:2.0:1787118764.782799:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118764.782807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1873929566229760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787118764.782883:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1873929566229760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.782890:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787118764.784054:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118764.784104:0:5844:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787118764.784111:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787118764.784139:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96136ebdbb80, transno 4294967301 00000100:00100000:3.0:1787118764.784152:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1873929566229760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787118764.784792:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787118764.784872:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1873929566229888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787118764.784928:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118764.784968:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118764.785305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566229888 00000100:00100000:0.0:1787118764.785313:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566229888 00000100:00100000:0.0:1787118764.785362:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118764.785371:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1873929566229888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787118764.785760:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1873929566229888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 349us (789us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787118764.785769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118764.785928:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9df800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1873929566229888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787118764.785990:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787118764.786037:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786049:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786072:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786088:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118764.786093:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786101:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786117:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:3.0:1787118764.786121:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787118764.786125:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118764.786140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8cb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787118764.786317:0:5844:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787118764.786398:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787118764.786409:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343943686515ns, next at 344943684504ns, rc = 0 00000001:00080000:3.0:1787118764.786415:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787118764.786446:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96136106b300) 00010000:00010000:3.0:1787118764.786450:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787118764.786457:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8c9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba76 expref: 46 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118764.786932:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+45:10550:x1873929544190080:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 11329us (11489us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787118764.786957:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 26 00000020:00080000:3.0:1787118764.786962:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787118764.790202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118764.790305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190336 00000100:00100000:2.0:1787118764.790315:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190336 00000100:00100000:2.0:1787118764.790410:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:2.0:1787118764.790420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+45:10550:x1873929544190336:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118764.790442:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118764.790465:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8cb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba7d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.790523:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba7d expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.790548:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba7d expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.790568:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118764.790571:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118764.790575:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987400, rc 0) 00000100:00100000:2.0:1787118764.790634:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:10550:x1873929544190336:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 215us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.790651:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:1.0:1787118764.796084:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.796169:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190592 00000100:00100000:0.0:1787118764.796179:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190592 00000100:00100000:0.0:1787118764.796235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:0.0:1787118764.796246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:10550:x1873929544190592:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118764.796492:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+47:10550:x1873929544190592:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 247us (424us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787118764.796501:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 27 00010000:00010000:2.0:1787118764.810809:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118764.900501:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118764.900647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190720 00000100:00100000:2.0:1787118764.900657:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190720 00000100:00100000:2.0:1787118764.900759:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:2.0:1787118764.900770:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+47:10560:x1873929544190720:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:2.0:1787118764.900847:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.900864:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.900876:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.900893:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.900900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.900905:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901002:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901010:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901016:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118764.901069:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901094:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901100:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901106:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901112:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118764.901116:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901122:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118764.901138:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118764.901142:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901147:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8cc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901159:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901164:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901176:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901181:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118764.901184:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901190:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901197:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94e00) 00010000:00010000:2.0:1787118764.901199:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118764.901201:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901206:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901219:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901224:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901228:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901232:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118764.901235:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901249:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901256:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118764.901259:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118764.901261:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.901266:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.901870:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+47:10560:x1873929544190720:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 1098us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.901879:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:0.0:1787118764.945187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118764.945286:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544190976 00000100:00100000:1.0:1787118764.945497:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544190976 00000100:00100000:1.0:1787118764.945651:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 102 00000100:00100000:1.0:1787118764.945662:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+47:10563:x1873929544190976:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118764.945683:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118764.945705:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8cd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba84 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945832:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945859:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945870:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945886:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945893:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.945900:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946024:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946033:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946039:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118764.946048:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787118764.946160:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946168:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946175:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946188:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.946193:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946200:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946211:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118764.946214:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.946218:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946223:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f8cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946236:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946242:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946247:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946251:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118764.946253:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946259:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946277:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96136106be00) 00010000:00010000:1.0:1787118764.946279:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118764.946282:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946288:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946499:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8cd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 50 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946514:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 49 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118764.946521:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118764.946524:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118764.946526:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8800, rc 0) 00000100:00100000:1.0:1787118764.946660:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+49:10563:x1873929544190976:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1000us (1541us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787118764.946669:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 102 00000100:00100000:3.0:1787118764.949455:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118764.949901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544191104 00000100:00100000:2.0:1787118764.949911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544191104 00000100:00100000:2.0:1787118764.950040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 103 00000100:00100000:2.0:1787118764.950051:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+49:10563:x1873929544191104:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:2.0:1787118764.950130:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950157:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950206:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950213:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950220:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118764.950224:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950232:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950244:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118764.950247:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118764.950251:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118764.950257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118764.950328:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+49:10563:x1873929544191104:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 278us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118764.950336:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 103 00000100:00100000:3.0:1787118764.952774:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118764.952902:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544191360 00000100:00100000:0.0:1787118764.952911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544191360 00000100:00100000:0.0:1787118764.952970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:0.0:1787118764.952979:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+49:10563:x1873929544191360:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118764.953210:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+50:10563:x1873929544191360:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 231us (487us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787118764.953217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:0.0:1787118765.046831:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.046925:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544191616 00000100:00100000:1.0:1787118765.046935:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544191616 00000100:00100000:1.0:1787118765.047007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00100000:1.0:1787118765.047017:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+50:10573:x1873929544191616:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118765.047038:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118765.047041:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787118765.047067:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8c7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba68 expref: 50 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047110:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:1.0:1787118765.047114:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118765.047136:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8cff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047228:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047241:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 50 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047249:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047279:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 50 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.047292:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 50 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118765.047305:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566230016:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118765.047412:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4900 going to sleep for 11 seconds 00000100:00080000:3.0:1787118765.047782:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118765.052767:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.052893:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566230016:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118765.052920:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.052989:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544191744 00000100:00100000:0.0:1787118765.052997:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544191744 00010000:00010000:0.0:1787118765.053040:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 51 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.053140:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:0.0:1787118765.053151:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+51:2368:x1873929544191744:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118765.053165:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118765.053172:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 51 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053184:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 51 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053205:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f8cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba84 expref: 51 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053220:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:0.0:1787118765.053224:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053233:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053240:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.053266:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118765.053321:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+50:2368:x1873929544191744:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 172us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.053328:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 52 00010000:00010000:1.0:1787118765.053463:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.053477:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118765.053495:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787118765.053636:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8cff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.053652:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.053659:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118765.053662:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787118765.053664:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9000, rc 0) 00000100:00100000:1.0:1787118765.053689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+50:10573:x1873929544191616:12345-192.168.203.10@tcp:101:bash.0 Request processed in 6675us (6867us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787118765.053696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00100000:2.0:1787118765.056818:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.057029:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192000 00000100:00100000:3.0:1787118765.057037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192000 00000100:00100000:3.0:1787118765.057097:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 105 00000100:00100000:3.0:1787118765.057107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+50:10573:x1873929544192000:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:3.0:1787118765.057471:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.057486:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.057497:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787118765.057560:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787118765.057583:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b8157c9 reply state 000000000cb88494 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118765.057592:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787118765.057679:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+53:10573:x1873929544192000:12345-192.168.203.10@tcp:36:bash.0 Request processed in 572us (869us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787118765.057687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 105 00000020:00080000:3.0:1787118765.057691:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787118765.062551:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.062644:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192128 00000100:00100000:1.0:1787118765.062655:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192128 00000100:00100000:1.0:1787118765.062711:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00100000:1.0:1787118765.062746:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+53:10573:x1873929544192128:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118765.062770:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118765.062789:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba92 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062873:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062905:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062912:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062918:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062933:0:7892:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062957:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.062969:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 54 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118765.062983:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566230144:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118765.063059:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118765.065874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.066012:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192256 00000100:00100000:1.0:1787118765.066020:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192256 00010000:00010000:1.0:1787118765.066054:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 55 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118765.066146:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:1.0:1787118765.066156:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:2369:x1873929544192256:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118765.066187:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118765.066195:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 55 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.066207:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 55 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.066228:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118765.066232:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.066240:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.066245:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.066251:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118765.066319:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:2369:x1873929544192256:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 165us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118765.066327:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 53 00010000:00010000:0.0:1787118765.066399:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066408:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066414:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066420:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118765.066425:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066432:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066441:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:0.0:1787118765.066443:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118765.066446:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066453:0:3285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066459:0:3285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066478:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.066484:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8d14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067333:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f8d06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba8b expref: 53 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.067371:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566230144:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118765.067392:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067400:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067405:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118765.067449:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787118765.067454:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118765.067474:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067507:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f8d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 53 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067521:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 52 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.067528:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:0.0:1787118765.067531:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118765.067534:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9c00, rc 0) 00000100:00100000:0.0:1787118765.067589:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+52:10573:x1873929544192128:12345-192.168.203.10@tcp:101:bash.0 Request processed in 4870us (5055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.067597:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00100000:3.0:1787118765.072394:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.072536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192512 00000100:00100000:2.0:1787118765.072555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192512 00000100:00100000:2.0:1787118765.072614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:2.0:1787118765.072624:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+52:10573:x1873929544192512:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:2.0:1787118765.072889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+53:10573:x1873929544192512:12345-192.168.203.10@tcp:35:bash.0 Request processed in 266us (504us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787118765.072897:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:3.0:1787118765.136114:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.136221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192640 00000100:00100000:2.0:1787118765.136231:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192640 00000100:00100000:2.0:1787118765.136286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:2.0:1787118765.136295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+53:10579:x1873929544192640:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118765.136331:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.136351:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2ba99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136413:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136425:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136435:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.136491:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787118765.136495:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118765.136518:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba99 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136572:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba99 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.136595:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118765.136598:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118765.136602:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118765.136667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544192640:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 373us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.136674:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118765.141246:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.141355:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544192768 00000100:00100000:2.0:1787118765.141365:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544192768 00000100:00100000:2.0:1787118765.141425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00100000:2.0:1787118765.141436:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544192768:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118765.141453:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.141472:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baa0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141536:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141561:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141570:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141585:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141591:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141612:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141709:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141718:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141745:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.141779:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787118765.141783:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118765.141803:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141814:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141822:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141828:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141834:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141839:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.141843:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141857:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141868:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118765.141871:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118765.141875:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141880:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141892:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141897:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141902:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141906:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.141909:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141914:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141921:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96134bc94e00) 00010000:00010000:2.0:1787118765.141923:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118765.141926:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141973:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa0 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141985:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa0 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.141991:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118765.141993:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118765.141996:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118765.142060:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:10579:x1873929544192768:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 626us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.142067:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00100000:0.0:1787118765.149447:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118765.149492:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.149592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193152 00000100:00100000:1.0:1787118765.149600:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193152 00000100:00100000:1.0:1787118765.149664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:1.0:1787118765.149675:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+55:2369:x1873929544193152:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118765.149689:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118765.149711:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8d4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa0 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.149777:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118765.149783:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118765.149845:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:2369:x1873929544193152:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118765.149853:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:2.0:1787118765.149926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193024 00000100:00100000:2.0:1787118765.149930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193024 00000100:00100000:2.0:1787118765.149968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 109 00000100:00100000:2.0:1787118765.149976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544193024:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118765.149992:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.150006:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.150107:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.150121:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 55 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.150141:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.150172:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 55 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.150186:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 55 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.150198:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566230272:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118765.150259:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787118765.154551:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118765.154682:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193280 00000100:00100000:0.0:1787118765.154692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193280 00010000:00010000:0.0:1787118765.154769:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 56 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.154805:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 54 00000100:00100000:0.0:1787118765.154815:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350044850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+56:2368:x1873929544193280:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118765.154830:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118765.154836:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 56 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.154849:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 56 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.154870:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:0.0:1787118765.154876:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.154885:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.154893:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.154912:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118765.154955:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350044850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+56:2368:x1873929544193280:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.154977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 54 00010000:00010000:2.0:1787118765.155417:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f8d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba92 expref: 55 pid: 7892 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.155433:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566230272:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118765.155454:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.155462:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.155468:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.155485:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787118765.155701:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.155814:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.155822:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118765.155825:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118765.155828:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118765.155862:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+55:10579:x1873929544193024:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 5887us (6427us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787118765.155870:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 109 00000100:00100000:3.0:1787118765.159465:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.160055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193536 00000100:00100000:1.0:1787118765.160065:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193536 00000100:00100000:1.0:1787118765.160179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:1.0:1787118765.160189:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+55:10579:x1873929544193536:12345-192.168.203.10@tcp:103:lfs.0 00010000:00010000:1.0:1787118765.160204:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118765.160230:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8cb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba7d expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.160246:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118765.160250:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118765.160314:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544193536:12345-192.168.203.10@tcp:103:lfs.0 Request processed in 126us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118765.160321:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:3.0:1787118765.162631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.162715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193664 00000100:00100000:2.0:1787118765.162738:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193664 00000100:00100000:2.0:1787118765.162799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 110 00000100:00100000:2.0:1787118765.162809:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544193664:12345-192.168.203.10@tcp:58:lfs.0 00010000:00010000:2.0:1787118765.162907:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.162923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.162933:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118765.163140:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787118765.163214:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544193664:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 407us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.163222:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 110 00000100:00100000:3.0:1787118765.165457:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.165560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193792 00000100:00100000:2.0:1787118765.165587:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193792 00000100:00100000:2.0:1787118765.165644:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 111 00000100:00100000:2.0:1787118765.165654:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:10579:x1873929544193792:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118765.165672:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.165691:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165770:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165781:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165799:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165812:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165825:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118765.165828:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118765.165833:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.165842:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986200, rc 0) 00000100:00100000:2.0:1787118765.165887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+55:10579:x1873929544193792:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 234us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.165894:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 111 00000040:00080000:3.0:1787118765.578021:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787118765.578031:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118765.578095:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787118765.578103:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787118765.578222:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f768700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566230400:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787118765.578341:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118765.586496:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f768700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566230400:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787118765.591105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.591382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544193920 00000100:00100000:2.0:1787118765.591390:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544193920 00000100:00100000:2.0:1787118765.591450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00100000:2.0:1787118765.591460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:10580:x1873929544193920:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787118765.591500:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787118765.591999:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:10580:x1873929544193920:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 538us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.592009:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00100000:3.0:1787118765.609091:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.609331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544194048 00000100:00100000:2.0:1787118765.609350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544194048 00000100:00100000:2.0:1787118765.609408:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 113 00000100:00100000:2.0:1787118765.609428:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+55:10580:x1873929544194048:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.609510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609527:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609549:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609610:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609619:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609626:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609676:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.609683:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.610052:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787118765.610058:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118765.610080:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610092:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610098:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610105:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610112:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.610115:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610122:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610134:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:2.0:1787118765.610144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118765.610150:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610156:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8d76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610171:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610177:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610183:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610188:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.610191:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610197:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610205:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff96134bc94e00) 00010000:00010000:2.0:1787118765.610207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118765.610210:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610215:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8d7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610229:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610240:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610245:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610251:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.610253:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610259:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610267:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118765.610269:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118765.610272:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.610277:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8d84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.610351:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+55:10580:x1873929544194048:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 Request processed in 932us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.610359:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 113 00000100:00100000:0.0:1787118765.616217:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.616656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544194304 00000100:00100000:2.0:1787118765.616666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544194304 00000100:00100000:2.0:1787118765.616746:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 114 00000100:00100000:2.0:1787118765.616758:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:10580:x1873929544194304:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.616777:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.616808:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8d8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bab5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.616976:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.616991:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617003:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.617015:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787118765.617117:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617124:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617131:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617138:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118765.617141:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617149:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617161:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118765.617164:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787118765.617168:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617184:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617225:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8d8b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bab5 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617236:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:2.0:1787118765.617239:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118765.617243:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f8d8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bab5 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.617252:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987a00, rc 0) 00000100:00100000:2.0:1787118765.617380:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544194304:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 625us (1173us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787118765.617389:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 114 00000100:00100000:0.0:1787118765.638282:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.638897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544194432 00000100:00100000:2.0:1787118765.638908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544194432 00000100:00100000:2.0:1787118765.638963:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 115 00000100:00100000:2.0:1787118765.638973:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544194432:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787118765.639027:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787118765.639360:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544194432:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 387us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.639368:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 115 00000100:00100000:0.0:1787118765.648024:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.650158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544194688 00000100:00100000:2.0:1787118765.650172:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544194688 00000100:00100000:2.0:1787118765.650247:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00100000:2.0:1787118765.650274:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544194688:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.650296:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.650299:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787118765.650326:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba99 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.650345:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118765.650350:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118765.650363:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8da0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2babc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787118765.650794:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787118765.650984:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.650998:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.651007:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.651057:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8da0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2babc expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.651083:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2babc expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.651091:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96134bc94e00) 00010000:00010000:2.0:1787118765.651094:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118765.651105:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118765.651164:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+57:10580:x1873929544194688:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 892us (3150us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787118765.651171:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 116 00000100:00100000:2.0:1787118765.654884:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.654996:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544194944 00000100:00100000:3.0:1787118765.655005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544194944 00000100:00100000:3.0:1787118765.655062:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:3.0:1787118765.655081:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+57:10580:x1873929544194944:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787118765.655135:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118765.655160:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2babc expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655179:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff96134bc94e00) 00010000:00010000:3.0:1787118765.655189:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118765.655209:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655240:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655250:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655263:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655270:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655276:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655345:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655351:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655357:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655362:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118765.655366:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655374:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655383:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118765.655392:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118765.655397:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8db5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655414:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655419:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655426:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655430:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118765.655433:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655438:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655446:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x357141e0 (ffff961359bc8d00) 00010000:00010000:3.0:1787118765.655449:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118765.655451:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.655455:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8dbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x357141e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118765.655617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544194944:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 545us (742us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787118765.655630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 117 00000100:00100000:0.0:1787118765.660187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.660261:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544195072 00000100:00100000:3.0:1787118765.660272:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544195072 00000100:00100000:3.0:1787118765.660326:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 118 00000100:00100000:3.0:1787118765.660335:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+56:10580:x1873929544195072:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118765.660361:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118765.660382:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8dc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bac3 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660416:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660439:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660450:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660845:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8dc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 58 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660873:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 57 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.660883:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:3.0:1787118765.660886:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787118765.660889:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d800, rc 0) 00000100:00100000:3.0:1787118765.660951:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+57:10580:x1873929544195072:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 617us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118765.660965:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 118 00000100:00100000:0.0:1787118765.676101:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.676255:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544195328 00000100:00100000:2.0:1787118765.676264:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544195328 00000100:00100000:2.0:1787118765.676325:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 119 00000100:00100000:2.0:1787118765.676334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+57:10580:x1873929544195328:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.676455:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.676470:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.676805:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118765.677059:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787118765.677077:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344834354757ns, next at 345834344191ns, rc = 0 00000004:00010000:2.0:1787118765.677159:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002620b39c reply state 000000006b25e28b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.677168:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118765.677257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+59:10580:x1873929544195328:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 921us (1164us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787118765.677265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 119 00010000:00010000:1.0:1787118765.685969:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.685985:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.685992:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.686020:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118765.686026:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.686033:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.686051:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:1.0:1787118765.686055:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787118765.686059:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.686065:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8dd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.694289:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.694452:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544195456 00000100:00100000:2.0:1787118765.694462:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544195456 00000100:00100000:2.0:1787118765.694524:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 120 00000100:00100000:2.0:1787118765.694595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+58:10580:x1873929544195456:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.694619:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.694639:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.694695:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.694709:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.694747:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:2.0:1787118765.694750:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118765.694754:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118765.694900:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+59:10580:x1873929544195456:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 367us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.694910:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 120 00000100:00100000:2.0:1787118765.698955:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.699034:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544195584 00000100:00100000:3.0:1787118765.699054:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544195584 00000100:00100000:3.0:1787118765.699179:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:3.0:1787118765.699190:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544195584:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787118765.699475:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544195584:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 287us (527us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787118765.699483:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00080000:2.0:1787118765.701243:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118765.703142:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.703235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544195840 00000100:00100000:2.0:1787118765.703244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544195840 00000100:00100000:2.0:1787118765.703301:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:2.0:1787118765.703311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+59:10580:x1873929544195840:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787118765.703658:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+60:10580:x1873929544195840:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 347us (532us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787118765.703667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:1.0:1787118765.706826:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.706953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196096 00000100:00100000:3.0:1787118765.706963:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196096 00000100:00100000:3.0:1787118765.707019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:3.0:1787118765.707028:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+60:10580:x1873929544196096:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787118765.707137:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+60:10580:x1873929544196096:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118765.707144:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:3.0:1787118765.710341:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.710497:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196224 00000100:00100000:2.0:1787118765.710506:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196224 00000100:00100000:2.0:1787118765.710568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:2.0:1787118765.710578:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+60:10580:x1873929544196224:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118765.710597:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118765.710617:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bad1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.710683:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.710696:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.710705:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118765.710781:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118765.710801:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.710979:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f8ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad1 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.710998:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad1 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.711007:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:2.0:1787118765.711009:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118765.711012:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118765.711086:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+61:10580:x1873929544196224:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 507us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.711093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 122 00000100:00100000:0.0:1787118765.715437:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.715782:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196352 00000100:00100000:1.0:1787118765.715791:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196352 00000100:00100000:1.0:1787118765.715851:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:1.0:1787118765.715862:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544196352:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787118765.715880:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118765.715899:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bad8 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787118765.715926:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8544ac, blocks: 0x1 00010000:00010000:1.0:1787118765.715947:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1787118765.715951:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118765.715960:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.715987:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118765.715999:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8000, rc 0) 00000100:00100000:1.0:1787118765.716051:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+10:2369:x1873929544196352:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 191us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118765.716059:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:0.0:1787118765.721851:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.722330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196608 00000100:00100000:3.0:1787118765.722339:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196608 00000100:00100000:3.0:1787118765.722498:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 123 00000100:00100000:3.0:1787118765.722509:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:10580:x1873929544196608:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787118765.722655:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:10580:x1873929544196608:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 148us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118765.722664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 123 00000100:00100000:0.0:1787118765.727151:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.727223:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196736 00000100:00100000:3.0:1787118765.727249:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196736 00000100:00100000:3.0:1787118765.727344:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:3.0:1787118765.727354:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:10580:x1873929544196736:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118765.727371:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118765.727389:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2badf expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.727682:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.727693:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118765.727698:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118765.727703:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.727804:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.727818:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 11 pid: 6703 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118765.727832:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566230528:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118765.728220:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118765.738023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.738150:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196864 00000100:00100000:2.0:1787118765.738159:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196864 00010000:00010000:2.0:1787118765.738198:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 12 pid: 6703 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.738242:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:2.0:1787118765.738252:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+12:2368:x1873929544196864:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118765.738266:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118765.738289:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 12 pid: 6703 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118765.738311:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f769500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566230528:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118765.738315:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 12 pid: 6703 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.738336:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e4a0126/0xaa534e3c784f8ded lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad8 expref: 12 pid: 6703 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.741850:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.741906:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118765.741911:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118765.741919:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.741928:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.742004:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118765.742261:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+11:2368:x1873929544196864:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 4008us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.742272:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 55 00010000:00010000:0.0:1787118765.742359:0:6704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118765.742376:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566230656:192.168.203.10@tcp:105: 00000100:00100000:0.0:1787118765.742981:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134313e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118765.757560:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566230656:192.168.203.10@tcp:105: 00010000:00010000:2.0:1787118765.757585:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:2.0:1787118765.757689:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:10580:x1873929544196736:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 30336us (30546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.757698:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:3.0:1787118765.768337:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118765.768458:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544196992 00000100:00100000:1.0:1787118765.768467:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544196992 00002000:00100000:1.0:1787118765.768521:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96137f769500 x1873929544196992/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:556/0 lens 504/0 e 0 to 0 dl 1787118776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787118765.768532:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f769500 with x1873929544196992 ext(0->12) 00002000:00010000:1.0:1787118765.768537:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137f769500 00000100:00100000:1.0:1787118765.768579:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:1.0:1787118765.768589:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:2369:x1873929544196992:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787118765.769301:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b9d85e8-2500-4b81-a525-0303ce911299+12:2369:x1873929544196992:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 Request processed in 710us (970us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787118765.769310:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00002000:00100000:1.0:1787118765.769319:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff96137f769500 x1873929544196992/t4294967308(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:556/0 lens 504/448 e 0 to 0 dl 1787118776 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787118765.769326:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f769500 with x1873929544196992 ext(0->12) 00002000:00010000:1.0:1787118765.769329:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137f769500 00000100:00100000:0.0:1787118765.785301:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118765.785392:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544197120 00000100:00100000:3.0:1787118765.785402:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544197120 00000100:00100000:3.0:1787118765.785467:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 124 00000100:00100000:3.0:1787118765.785478:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+61:10580:x1873929544197120:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787118765.833830:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118765.889808:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+61:10580:x1873929544197120:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 Request processed in 104322us (104505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118765.889822:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 124 00000001:00080000:3.0:1787118765.892309:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967391 is committed 00000020:00080000:3.0:1787118765.892330:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961341377240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787118765.892335:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96137b493d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961341377f00 00000020:00080000:3.0:1787118765.892338:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96137b493400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136e5ae400 00000001:00080000:3.0:1787118765.892355:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:3.0:1787118765.892367:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:3.0:1787118765.892441:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787118765.892448:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787118765.893119:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:1.0:1787118765.893341:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787118765.897981:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566231168:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898121:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787118765.898127:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566230784:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898178:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566231296:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898254:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566230912:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898292:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566231424:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898326:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787118765.898331:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566231040:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118765.898378:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231168 00000100:00100000:0.0:1787118765.898385:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231168 00000100:00100000:0.0:1787118765.898431:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231424 00000100:00100000:0.0:1787118765.898434:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231424 00000100:00100000:0.0:1787118765.898454:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787118765.898462:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566231168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898512:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566231168:12345-0@lo:400:kworker.0 Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898519:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787118765.898606:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787118765.898613:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566231424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898646:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566231424:12345-0@lo:400:kworker.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898652:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787118765.898671:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566230784 00000100:00100000:0.0:1787118765.898674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566230784 00000100:00100000:0.0:1787118765.898696:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787118765.898703:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898767:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566230784:12345-0@lo:400:kworker.0 Request processed in 64us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787118765.898801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231296 00000100:00100000:0.0:1787118765.898805:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231296 00000100:00100000:0.0:1787118765.898828:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566230912 00000100:00100000:0.0:1787118765.898831:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566230912 00000100:00100000:0.0:1787118765.898841:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231040 00000100:00100000:0.0:1787118765.898844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231040 00000100:00100000:0.0:1787118765.898856:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787118765.898862:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566231296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898890:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566231296:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787118765.898909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787118765.898914:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566230912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566230912:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787118765.898954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787118765.898959:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.898984:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566231040:12345-0@lo:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118765.898989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787118765.899030:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566231040:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.899042:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566230912:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.899061:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566231424:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.899104:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566230784:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.899112:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566231296:0@lo:400:kworker.0 00000100:00100000:0.0:1787118765.899120:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566231168:0@lo:400:kworker.0 00000100:00080000:2.0:1787118765.901679:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787118765.901689:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118765.902451:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118765.903695:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787118765.903712:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961351523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566231680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787118765.903804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118765.903853:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231680 00000100:00100000:2.0:1787118765.903860:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231680 00000100:00100000:2.0:1787118765.903899:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787118765.903907:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566231680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787118765.904078:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787118765.904081:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787118764 00002000:00010000:2.0:1787118765.904083:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787118765.904085:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787118764 -> 1787118764 00002000:00010000:2.0:1787118765.904087:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787118765.904126:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566231680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (322us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787118765.904134:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1787118765.904171:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961351523b80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787118765.904177:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961351523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566231680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1787118765.904510:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787118765.904529:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96136e992f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787118765.904538:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96135143a000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96136e9923c0 00000020:00080000:3.0:1787118765.904554:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96135143ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136eb8d000 00000020:00080000:3.0:1787118765.904588:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1787118765.905395:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118765.905420:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544197248 00000100:00100000:0.0:1787118765.905426:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544197248 00000100:00100000:0.0:1787118765.905462:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:0.0:1787118765.905469:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+12:2368:x1873929544197248:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787118765.906098:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566231808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787118765.906144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118765.907352:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231808 00000100:00100000:2.0:1787118765.907360:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231808 00000100:00100000:2.0:1787118765.907409:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787118765.907417:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566231808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787118765.907441:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787118765.907482:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8544ab, atime: 0x6a8544ab, ctime: 0x6a8544ab, blocks: 0x1 00010000:00010000:2.0:1787118765.907490:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.907506:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1787118765.907510:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118765.907516:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.907592:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.907602:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.907610:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.907635:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118765.908989:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118765.909001:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.909012:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118765.909017:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.909027:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.909048:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.909055:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2b5ea4d/0xaa534e3c784f8dfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.909090:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118765.909092:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118765.909094:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787118765.909929:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787118765.909987:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787118765.912486:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566231808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5061us (6333us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787118765.912498:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787118765.912713:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566231552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787118765.912775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118765.913637:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566231552 00000100:00100000:2.0:1787118765.913646:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566231552 00000100:00100000:2.0:1787118765.913701:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787118765.913710:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566231552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787118765.913766:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787118765.913805:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.913825:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 12 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.913834:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787118765.913839:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787118765.913844:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.913878:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 12 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.913893:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 12 pid: 6703 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.913906:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566231936:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118765.914429:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787118765.916082:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96136ebc5880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787118765.916094:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566231808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787118765.919656:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566231936:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118765.919686:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118765.929003:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118765.939390:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544197376 00000100:00100000:2.0:1787118765.939404:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544197376 00010000:00010000:2.0:1787118765.939455:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 13 pid: 6703 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118765.939504:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:2.0:1787118765.939514:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+13:2368:x1873929544197376:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118765.939545:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118765.939552:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 13 pid: 6703 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.939566:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 13 pid: 6703 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.939589:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d8a0d14/0xaa534e3c784f8bbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba3e expref: 13 pid: 6703 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.939607:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787118765.939611:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787118765.939617:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.939627:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118765.939664:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118765.939747:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+12:2368:x1873929544197376:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 208us (10726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118765.939756:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 56 00010000:00010000:3.0:1787118765.940146:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.940157:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.940167:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.940176:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118765.940207:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787118765.940687:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3300:x1873929566231552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26977us (27911us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787118765.940696:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1787118765.941296:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118765.941305:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.941315:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118765.941320:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.941329:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.941346:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.941368:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c1c051/0xaa534e3c784f8e02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118765.941385:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118765.941387:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118765.941389:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787118765.941920:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9613500ea300/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787118765.941930:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566231552:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787118766.011534:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787118766.011553:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787118766.011563:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787118766.011708:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544197248:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 Request processed in 106233us (106311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118766.011718:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:3.0:1787118766.014455:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118766.014563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544197632 00000100:00100000:0.0:1787118766.014572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544197632 00000100:00100000:0.0:1787118766.014623:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 125 00000100:00100000:0.0:1787118766.014633:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+15:10580:x1873929544197632:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787118766.014684:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118766.014712:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8de6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bad1 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.014762:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:0.0:1787118766.014767:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118766.014795:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.014808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.014817:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118766.015053:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c3137b2 reply state 00000000d1414c63 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118766.015062:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787118766.015169:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+16:10580:x1873929544197632:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 537us (723us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787118766.015176:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 125 00000100:00100000:2.0:1787118766.020993:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:0.0:1787118766.021120:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021141:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021149:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021155:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118766.021159:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021166:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021181:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:0.0:1787118766.021193:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118766.021197:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.021203:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118766.022866:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544197760 00000100:00100000:3.0:1787118766.022877:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544197760 00000100:00100000:3.0:1787118766.022990:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:3.0:1787118766.023000:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544197760:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787118766.023234:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787118766.023238:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787118764 -> 1787118764 00002000:00010000:3.0:1787118766.023241:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787118763 00002000:00010000:3.0:1787118766.023243:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787118764 -> 1787118764 00002000:00010000:3.0:1787118766.023245:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787118766.025815:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544197760:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 2806us (4820us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787118766.025829:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:2.0:1787118766.041614:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118766.041763:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198016 00000100:00100000:0.0:1787118766.041773:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198016 00000100:00100000:0.0:1787118766.041831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:0.0:1787118766.041841:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+15:10580:x1873929544198016:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787118766.041908:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.041924:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 15 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.041932:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.041963:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 15 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.041976:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 15 pid: 7892 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118766.041990:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566232064:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118766.042104:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13180 going to sleep for 11 seconds 00000100:00100000:0.0:1787118766.054140:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566232064:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118766.054170:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118766.055353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118766.055502:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198144 00000100:00100000:1.0:1787118766.055510:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198144 00010000:00010000:1.0:1787118766.055549:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 16 pid: 7892 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118766.055591:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:1.0:1787118766.055602:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:2368:x1873929544198144:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118766.055617:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118766.055624:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 16 pid: 7892 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055637:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 16 pid: 7892 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055675:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f8dca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bac3 expref: 16 pid: 7892 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055690:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:1.0:1787118766.055694:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055703:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055710:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.055788:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118766.055839:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:2368:x1873929544198144:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 239us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118766.055853:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 57 00010000:00010000:3.0:1787118766.056238:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056247:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056284:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056295:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056313:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118766.056317:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056325:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056347:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:3.0:1787118766.056350:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787118766.056354:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.056359:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118766.056422:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:10580:x1873929544198016:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 Request processed in 14582us (14815us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787118766.056431:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 126 00000100:00100000:2.0:1787118766.068399:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118766.068552:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198272 00000100:00100000:3.0:1787118766.068561:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198272 00000100:00100000:3.0:1787118766.068613:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:3.0:1787118766.068622:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544198272:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787118766.068662:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.068681:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.068690:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787118766.068694:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118766.068699:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.068768:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.068789:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 7 pid: 6704 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118766.068804:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566232192:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118766.068998:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118766.077109:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118766.077670:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1873929566232192:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118766.077698:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118766.077923:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198400 00000100:00100000:0.0:1787118766.077931:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198400 00010000:00010000:0.0:1787118766.077982:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 8 pid: 6704 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118766.078022:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 58 00000100:00100000:0.0:1787118766.078030:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544198400:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118766.078046:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118766.078076:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 8 pid: 6704 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.078088:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 8 pid: 6704 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.078109:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c6fb3bc/0xaa534e3c784f8df4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2badf expref: 8 pid: 6704 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.078132:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118766.078136:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118766.078141:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.078151:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.078177:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118766.078282:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544198400:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 252us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118766.078291:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 58 00010000:00010000:2.0:1787118766.078648:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078659:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078684:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078692:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078700:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078706:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118766.078711:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078756:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078782:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.078790:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4025ed3/0xaa534e3c784f8e17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118766.078835:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544198272:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 Request processed in 10214us (10445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118766.078843:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:1.0:1787118766.090260:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118766.094000:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198656 00000100:00100000:0.0:1787118766.094015:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198656 00000100:00100000:1.0:1787118766.094351:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 127 00000100:00100000:1.0:1787118766.094372:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+14:10580:x1873929544198656:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787118766.094454:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094471:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094482:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094766:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094777:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094785:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094818:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.094832:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 15 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118766.094846:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566232320:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118766.094936:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118766.100131:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a606d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566232320:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118766.100161:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118766.104663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118766.105025:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198784 00000100:00100000:2.0:1787118766.105034:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198784 00010000:00010000:2.0:1787118766.105082:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 16 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118766.105139:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:2.0:1787118766.105149:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:2371:x1873929544198784:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118766.105163:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118766.105171:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 16 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105196:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 16 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105222:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8dd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baca expref: 16 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105259:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:2.0:1787118766.105265:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105274:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105281:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.105528:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118766.105596:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:2371:x1873929544198784:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 448us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118766.105604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 59 00010000:00010000:1.0:1787118766.105847:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.105856:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118766.106045:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787118766.106368:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787118766.106416:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787118766.106494:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566232448:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787118766.106562:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118766.106594:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118766.110619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566232448 00000100:00100000:2.0:1787118766.110632:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566232448 00000100:00100000:2.0:1787118766.110694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118766.110703:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566232448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787118766.110838:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566232448:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118766.110845:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118766.110978:0:7892:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787118766.110984:0:7892:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787118766.111004:0:7892:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961351523b80, transno 4294967309 00000100:00100000:1.0:1787118766.111024:0:7892:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9613500ea300 x1873929566231552/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787118781 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118766.111036:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566232448:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787118766.113683:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787118766.114107:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566232576:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787118766.114182:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118766.114226:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787118766.114315:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566232576 00000100:00100000:2.0:1787118766.114322:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566232576 00000100:00100000:2.0:1787118766.114375:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787118766.114385:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566232576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787118766.114615:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7892:x1873929566232576:12345-0@lo:1000:mdt00_003.0 Request processed in 231us (432us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787118766.114639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118766.115147:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a606300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566232576:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787118766.115188:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115199:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115208:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115214:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118766.115226:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115235:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115252:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961359bc8600) 00010000:00010000:1.0:1787118766.115255:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118766.115259:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115266:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8e25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115294:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115311:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115317:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115323:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118766.115326:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115332:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115340:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118766.115342:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118766.115355:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115367:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115375:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118766.115404:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118766.115417:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a605500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566232704:192.168.203.10@tcp:105: 00000100:00100000:1.0:1787118766.115483:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787118766.121086:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118766.121205:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a605500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566232704:192.168.203.10@tcp:105: 00010000:00010000:2.0:1787118766.121232:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121242:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f8d68 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121272:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121285:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121310:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121322:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121329:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121335:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121341:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118766.121345:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121352:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121376:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118766.121379:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118766.121382:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121388:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f8e2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121397:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121403:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121408:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121413:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118766.121416:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121422:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121429:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118766.121431:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787118766.121433:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.121438:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8e1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118766.121688:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+18:10580:x1873929544198656:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 27325us (31434us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787118766.121698:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 127 00000020:00080000:2.0:1787118766.121704:0:7892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787118766.122864:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787118766.122871:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118766.123427:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787118766.123436:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787118766.123837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544198912 00000100:00100000:0.0:1787118766.123845:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544198912 00000100:00100000:0.0:1787118766.123901:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:0.0:1787118766.123910:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+18:10579:x1873929544198912:12345-192.168.203.10@tcp:49:lfs.0 00000100:00100000:0.0:1787118766.124037:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+18:10579:x1873929544198912:12345-192.168.203.10@tcp:49:lfs.0 Request processed in 127us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118766.124044:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:1.0:1787118766.131004:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118766.131058:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118766.131233:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544199168 00000100:00100000:2.0:1787118766.131242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544199168 00000100:00100000:2.0:1787118766.131313:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 128 00000100:00100000:2.0:1787118766.131324:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+18:10579:x1873929544199168:12345-192.168.203.10@tcp:58:lfs.0 00000040:00080000:2.0:1787118766.132048:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787118766.132149:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+18:10579:x1873929544199168:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 825us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118766.132158:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 128 00000100:00100000:0.0:1787118766.133074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544199424 00000100:00100000:0.0:1787118766.133083:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544199424 00000100:00100000:0.0:1787118766.133148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:0.0:1787118766.133157:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+18:10580:x1873929544199424:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787118766.134135:0:5845:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787118766.134234:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787118766.134278:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.134294:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.135017:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.135027:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.135033:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.135051:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118766.135127:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787118766.135235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+20:10580:x1873929544199424:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 2076us (4173us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787118766.135244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 32 00000020:00080000:0.0:1787118766.135250:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787118766.146791:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118766.146805:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.146817:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118766.146822:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.146830:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.146848:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff961351704300) 00010000:00010000:2.0:1787118766.146852:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787118766.146856:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.146884:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118766.146911:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118766.146913:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118766.146915:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118766.184535:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118766.184648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544199552 00000100:00100000:3.0:1787118766.184658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544199552 00000100:00100000:3.0:1787118766.184767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 129 00000100:00100000:3.0:1787118766.184777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+20:10582:x1873929544199552:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118766.184808:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118766.184830:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bae6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184893:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184908:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184919:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184934:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184961:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.184967:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.185254:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.185266:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.185274:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.185648:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.185664:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118766.185678:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f76a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566232832:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118766.186258:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118766.189784:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118766.189944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544199808 00000100:00100000:2.0:1787118766.189954:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544199808 00000100:00100000:3.0:1787118766.190054:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f76a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566232832:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118766.190093:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118766.190982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:2.0:1787118766.190996:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:5608:x1873929544199808:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787118766.191252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:5608:x1873929544199808:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 259us (1477us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787118766.191259:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:1.0:1787118766.194953:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118766.195056:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544199936 00000100:00100000:3.0:1787118766.195136:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544199936 00010000:00010000:3.0:1787118766.195180:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118766.195225:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:3.0:1787118766.195235:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350047c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:2369:x1873929544199936:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118766.195249:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118766.195256:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195267:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195286:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f8d5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baa7 expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195316:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:3.0:1787118766.195321:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195331:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195339:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195363:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118766.195412:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350047c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+22:2369:x1873929544199936:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118766.195429:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 60 00010000:00010000:3.0:1787118766.195485:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195492:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118766.195546:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787118766.195551:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118766.195570:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195592:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195599:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195606:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195612:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118766.195616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195624:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195633:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:3.0:1787118766.195642:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118766.195647:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195654:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195666:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195672:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195678:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195684:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118766.195687:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195693:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195700:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff961359bc8d00) 00010000:00010000:3.0:1787118766.195702:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118766.195705:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195711:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195791:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bae6 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195820:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bae6 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118766.195828:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:3.0:1787118766.195830:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118766.195832:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:3.0:1787118766.195860:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+21:10582:x1873929544199552:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 11085us (11336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118766.195868:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 129 00000100:00100000:3.0:1787118766.410925:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118766.410950:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118766.411034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118766.411318:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566232960 00000100:00100000:0.0:1787118766.411326:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566232960 00000100:00100000:0.0:1787118766.411388:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787118766.411399:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566232960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118766.411444:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118766.411490:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566232960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118766.411497:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787118766.411796:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118766.411835:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566232960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118766.864805:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118766.934417:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566233088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118766.934998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118766.935112:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233088 00000100:00100000:0.0:1787118766.935119:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233088 00000100:00100000:0.0:1787118766.935169:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787118766.935177:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566233088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118766.935213:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118766.942625:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566233088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7438us (7618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118766.942639:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787118766.948196:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566233088:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787118767.051429:0:12120:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118767.051438:0:12120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787118767.051815:0:12120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787118767.051822:0:12120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787118767.199634:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118767.199643:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118767.199704:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787118767.199710:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118767.199864:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566233216:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787118767.199956:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613476d4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118767.204988:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eb8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566233216:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787118767.205227:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118767.205285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544200064 00000100:00100000:1.0:1787118767.205292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544200064 00000100:00100000:1.0:1787118767.205361:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 130 00000100:00100000:1.0:1787118767.205371:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:10594:x1873929544200064:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1787118767.205377:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1787118767.205402:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787118767.205500:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:10594:x1873929544200064:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 130us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118767.205508:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 130 00000100:00100000:1.0:1787118767.224208:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118767.224429:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544200320 00000100:00100000:3.0:1787118767.224439:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544200320 00000100:00100000:3.0:1787118767.224505:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 131 00000100:00100000:3.0:1787118767.224518:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+21:10594:x1873929544200320:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118767.224550:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118767.224571:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baed expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.224684:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.224697:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.224709:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118767.224746:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787118767.224881:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baed expref: 24 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.224897:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baed expref: 23 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.224905:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:3.0:1787118767.224907:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118767.224910:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c600, rc 0) 00000100:00100000:3.0:1787118767.224971:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:10594:x1873929544200320:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 457us (773us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787118767.224979:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 131 00000100:00100000:1.0:1787118767.232334:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118767.232406:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544200448 00000100:00100000:2.0:1787118767.232415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544200448 00000100:00100000:2.0:1787118767.232486:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:2.0:1787118767.232497:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:2370:x1873929544200448:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118767.232513:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118767.232547:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f8e5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baed expref: 23 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118767.232568:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118767.232583:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118767.232639:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:2370:x1873929544200448:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118767.232647:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118767.240652:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118767.240762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544200704 00000100:00100000:3.0:1787118767.240770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544200704 00000100:00100000:3.0:1787118767.240823:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 132 00000100:00100000:3.0:1787118767.240833:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+22:10594:x1873929544200704:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787118767.240913:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.240934:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.240945:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241143:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241151:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241158:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241165:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ce00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118767.241170:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241176:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:3.0:1787118767.241191:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787118767.241266:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118767.241272:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118767.241416:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+23:10594:x1873929544200704:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 583us (772us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787118767.241430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 132 00000040:00080000:0.0:1787118767.241986:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118767.241992:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118767.242633:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787118767.242643:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118767.255108:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118767.255259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544200960 00000100:00100000:0.0:1787118767.255268:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544200960 00000100:00100000:0.0:1787118767.255323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:0.0:1787118767.255333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+23:10594:x1873929544200960:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787118767.255566:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:10594:x1873929544200960:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 233us (465us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787118767.255574:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 34 00010000:00010000:3.0:1787118767.882549:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787118768.019906:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787118768.019931:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787118768.019937:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1787118768.905879:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787118769.040878:0:12174:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118769.040887:0:12174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118769.040931:0:12174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787118769.040938:0:12174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118769.304423:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118769.307100:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201216 00000100:00100000:3.0:1787118769.307114:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201216 00000100:00080000:0.0:1787118769.307411:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118769.307477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 133 00000100:00100000:3.0:1787118769.307488:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:10615:x1873929544201216:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118769.307509:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118769.307528:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2baf4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118769.307622:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118769.307636:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118769.308067:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118769.308516:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787118769.308896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f8e72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baf4 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118769.308914:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baf4 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118769.308923:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:1.0:1787118769.308925:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787118769.308929:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:1.0:1787118769.308989:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+26:10615:x1873929544201216:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1503us (4573us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787118769.309007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 133 00000100:00100000:3.0:1787118769.314923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118769.316682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201344 00000100:00100000:0.0:1787118769.316695:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201344 00000100:00100000:0.0:1787118769.316774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 134 00000100:00100000:0.0:1787118769.316783:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+26:10615:x1873929544201344:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118769.316854:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316870:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316924:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316931:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316938:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316944:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118769.316948:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316956:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316968:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:0.0:1787118769.316971:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118769.316976:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.316981:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031400/0xaa534e3c784f8e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118769.317078:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+26:10615:x1873929544201344:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 295us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118769.317086:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 134 00000100:00100000:1.0:1787118769.422976:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118769.423154:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201472 00000100:00100000:0.0:1787118769.423165:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201472 00000100:00100000:0.0:1787118769.423275:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:0.0:1787118769.423298:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2371:x1873929544201472:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:0.0:1787118769.423321:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118769.423340:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f8e8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bafb expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118769.423379:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8544ac, atime: 0x6a8544ab, ctime: 0x6a8544ac, blocks: 0xb 00010000:00010000:0.0:1787118769.423407:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1787118769.423412:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118769.423421:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f8e8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bafb expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.423439:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f8e8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bafb expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118769.423452:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340031400, rc 0) 00000100:00100000:0.0:1787118769.423513:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544201472:12345-192.168.203.10@tcp:101:cat.0 Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118769.423520:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00080000:3.0:1787118769.423652:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118769.428153:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118769.428758:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201600 00000100:00100000:2.0:1787118769.428769:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201600 00002000:00100000:2.0:1787118769.428823:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff96137a808700 x1873929544201600/t0(0) o3->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:560/0 lens 488/0 e 0 to 0 dl 1787118780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787118769.428833:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137a808700 with x1873929544201600 ext(0->4095) 00002000:00010000:2.0:1787118769.428839:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137a808700 00000100:00100000:2.0:1787118769.428879:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:2.0:1787118769.428890:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2370:x1873929544201600:12345-192.168.203.10@tcp:3:cat.0 00000100:00100000:2.0:1787118769.429140:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2370:x1873929544201600:12345-192.168.203.10@tcp:3:cat.0 Request processed in 251us (996us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787118769.429147:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00002000:00100000:2.0:1787118769.429153:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff96137a808700 x1873929544201600/t0(0) o3->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:560/0 lens 488/4536 e 0 to 0 dl 1787118780 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787118769.429160:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137a808700 with x1873929544201600 ext(0->4095) 00002000:00010000:2.0:1787118769.429163:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137a808700 00000100:00100000:1.0:1787118769.886993:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118769.887162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201728 00000100:00100000:2.0:1787118769.887172:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201728 00000100:00100000:2.0:1787118769.887234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 297 00000100:00100000:2.0:1787118769.887244:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544201728:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118769.887321:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544201728:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118769.887347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 297 00000100:00100000:1.0:1787118769.887889:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118769.887946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118769.888056:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201984 00000100:00100000:3.0:1787118769.888061:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201984 00000100:00100000:3.0:1787118769.888121:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 148 00000100:00100000:3.0:1787118769.888129:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544201984:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118769.888179:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2371:x1873929544201984:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118769.888195:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 148 00000100:00080000:1.0:1787118769.888914:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118769.890385:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544201856 00000100:00100000:0.0:1787118769.890394:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544201856 00000100:00100000:0.0:1787118769.890466:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:0.0:1787118769.890474:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544201856:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118769.890549:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544201856:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 76us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118769.890557:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00080000:1.0:1787118769.890643:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787118769.929921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787118770.313916:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118770.313924:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118770.313951:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787118770.313957:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787118770.953861:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118771.023698:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566233600:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.023794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.023851:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118771.023857:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566233728:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.023884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.023955:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566233344:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.023985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.024008:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566233856:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.024029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.024061:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787118771.024067:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566233472:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.024099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.024116:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566233984:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.024135:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118771.024190:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233344 00000100:00100000:1.0:1787118771.024197:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233344 00000100:00100000:1.0:1787118771.024239:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787118771.024248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.026662:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566233344:12345-0@lo:400:kworker.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118771.026695:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787118771.026784:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233600 00000100:00100000:1.0:1787118771.026791:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233600 00000100:00100000:1.0:1787118771.026845:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233856 00000100:00100000:1.0:1787118771.026849:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233856 00000100:00100000:1.0:1787118771.026863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233472 00000100:00100000:1.0:1787118771.026866:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233472 00000100:00100000:1.0:1787118771.026878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787118771.026886:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566233600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.026965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566233600:12345-0@lo:400:kworker.0 Request processed in 79us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118771.026972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787118771.026985:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787118771.026991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.027018:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566233856:12345-0@lo:400:kworker.0 Request processed in 28us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118771.027024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787118771.027046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787118771.027053:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566233472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.027081:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566233472:12345-0@lo:400:kworker.0 Request processed in 29us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118771.027589:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233728 00000100:00100000:0.0:1787118771.027595:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233728 00000100:00100000:0.0:1787118771.027627:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566233984 00000100:00100000:0.0:1787118771.027630:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566233984 00000100:00100000:0.0:1787118771.027654:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787118771.027662:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566233728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.027716:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566233728:12345-0@lo:400:kworker.0 Request processed in 55us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118771.027742:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787118771.027757:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787118771.027763:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566233984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.027794:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566233984:12345-0@lo:400:kworker.0 Request processed in 31us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118771.027800:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787118771.028477:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118771.028482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118771.028485:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118771.028528:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566233472:0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.028540:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787118771.028546:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787118771.028566:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96136ebc5880, transno 4294967304 00000100:00100000:0.0:1787118771.028580:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566233984:0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.028592:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566233344:0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.028604:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566233856:0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.028651:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566233728:0@lo:400:kworker.0 00000100:00100000:0.0:1787118771.028678:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566233600:0@lo:400:kworker.0 00000100:00100000:1.0:1787118771.030950:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000001:00080000:1.0:1787118771.134347:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787118771.134365:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787118771.162384:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1787118771.162407:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1787118771.162415:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787118771.162425:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9613476d4000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787118771.162429:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961350e65200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9613476d4480 00000020:00080000:3.0:1787118771.162432:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961350e65500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136e9f6c00 00000020:00080000:0.0:1787118771.162470:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787118771.162830:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1787118771.163204:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000100:00100000:1.0:1787118771.530322:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566234112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118771.530408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118771.530550:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234112 00000100:00100000:2.0:1787118771.530561:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234112 00000100:00100000:2.0:1787118771.530612:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787118771.530621:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566234112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787118771.530657:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118771.530713:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566234112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118771.530747:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787118771.531327:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566234112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787118771.977968:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118772.041989:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118772.042011:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566234240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118772.042088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118772.042282:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234240 00000100:00100000:0.0:1787118772.042290:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234240 00000100:00100000:0.0:1787118772.042341:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787118772.042351:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566234240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118772.042387:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118772.042448:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566234240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118772.042455:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787118772.042534:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787118772.042540:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9613500ea300, transno 4294967310 00000004:00080000:3.0:1787118772.042556:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787118772.042586:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566234240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118773.001940:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118774.027792:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118775.002651:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118775.003103:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118775.003145:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118775.003180:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118775.003190:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202240 00000100:00100000:2.0:1787118775.003209:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202240 00000100:00100000:2.0:1787118775.003279:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 152 00000100:00100000:2.0:1787118775.003289:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:2371:x1873929544202240:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118775.003373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:2371:x1873929544202240:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118775.003380:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 152 00000100:00100000:1.0:1787118775.003418:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202368 00000100:00100000:1.0:1787118775.003424:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202368 00000100:00100000:1.0:1787118775.003461:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202496 00000100:00100000:1.0:1787118775.003464:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202496 00000100:00100000:1.0:1787118775.003495:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:1.0:1787118775.003503:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544202368:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118775.003547:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544202368:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118775.003554:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:1.0:1787118775.003568:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 89 00000100:00100000:1.0:1787118775.003574:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544202496:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118775.003596:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544202496:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118775.003602:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 89 00000100:00080000:3.0:1787118775.003671:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118775.003676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118775.003678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118775.004053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202112 00000100:00100000:0.0:1787118775.004058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202112 00000100:00100000:0.0:1787118775.004094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 299 00000100:00100000:0.0:1787118775.004102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544202112:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118775.004131:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544202112:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 30us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118775.004137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 299 00000100:00100000:3.0:1787118775.010246:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118775.010354:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202624 00000100:00100000:0.0:1787118775.010362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202624 00000100:00100000:0.0:1787118775.010442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 153 00000100:00100000:0.0:1787118775.010454:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544202624:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118775.010535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544202624:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118775.010559:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 153 00000100:00080000:3.0:1787118775.011013:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118775.049949:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118775.150862:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118775.151033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544202752 00000100:00100000:0.0:1787118775.151046:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544202752 00000100:00100000:0.0:1787118775.151117:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 135 00000100:00100000:0.0:1787118775.151134:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:10259:x1873929544202752:12345-192.168.203.10@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787118775.151270:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:10259:x1873929544202752:12345-192.168.203.10@tcp:60:lhsmtool_posix.0 Request processed in 143us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118775.151278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 135 00000100:00100000:2.0:1787118775.164392:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118775.164525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203008 00000100:00100000:3.0:1787118775.164537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203008 00000100:00100000:3.0:1787118775.164615:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:3.0:1787118775.164625:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:10259:x1873929544203008:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787118775.165434:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+14:10259:x1873929544203008:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 804us (1050us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787118775.165445:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:3.0:1787118775.582974:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118775.583111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203136 00000100:00100000:0.0:1787118775.583124:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203136 00000100:00100000:0.0:1787118775.583211:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 136 00000100:00100000:0.0:1787118775.583224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:11067:x1873929544203136:12345-192.168.203.10@tcp:101:lsof.0 00010000:00010000:0.0:1787118775.583252:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118775.583278:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb02 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.583359:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.583376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.583389:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118775.588577:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787118775.588587:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118775.588754:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.588800:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.588824:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118775.588833:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:0.0:1787118775.588835:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118775.588840:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961340030200, rc 0) 00000100:00100000:0.0:1787118775.588910:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:11067:x1873929544203136:12345-192.168.203.10@tcp:101:lsof.0 Request processed in 5689us (5950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118775.588918:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 136 00010000:00010000:3.0:1787118776.073925:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118776.137985:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566234368:0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.138078:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566234496:0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.138085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118776.138178:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566234880:0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.138189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118776.138300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234368 00000100:00100000:0.0:1787118776.138311:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234368 00000100:00100000:0.0:1787118776.138359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787118776.138369:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566234368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118776.138873:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566234752:0@lo:400:kworker.0 00000100:00100000:0.0:1787118776.146691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566234368:12345-0@lo:400:kworker.0 Request processed in 8315us (8600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118776.146707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787118776.146952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118776.146990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234496 00000100:00100000:2.0:1787118776.147010:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234496 00000100:00100000:2.0:1787118776.147060:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234880 00000100:00100000:2.0:1787118776.147063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234880 00000100:00100000:2.0:1787118776.147089:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787118776.147098:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566234496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118776.147813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787118776.147935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566234880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118776.147986:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566234880:12345-0@lo:400:kworker.0 Request processed in 164us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118776.147993:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787118776.150981:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566234496:12345-0@lo:400:kworker.0 Request processed in 3874us (12786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118776.150995:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787118776.151051:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118776.151103:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566234880:0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.151192:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566234368:0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.151332:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566234624:0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.151374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118776.151421:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234624 00000100:00100000:2.0:1787118776.151427:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234624 00000100:00100000:2.0:1787118776.151474:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787118776.151482:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566234624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.151536:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566234624:12345-0@lo:400:kworker.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118776.151543:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787118776.151560:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118776.151633:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566234624:0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.159983:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566234496:0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.160017:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566235008:0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.160105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118776.160383:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235008 00000100:00100000:2.0:1787118776.160393:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235008 00000100:00080000:2.0:1787118776.160917:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118776.160936:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787118776.160950:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118776.161040:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566235008:12345-0@lo:400:kworker.0 Request processed in 93us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118776.161059:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787118776.161188:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566235008:0@lo:400:kworker.0 00000100:00100000:3.0:1787118776.161772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118776.161862:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566234752 00000100:00100000:1.0:1787118776.161868:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566234752 00000100:00100000:1.0:1787118776.161924:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787118776.161933:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566234752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118776.161979:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566234752:12345-0@lo:400:kworker.0 Request processed in 47us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118776.161986:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1787118776.162060:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118776.162083:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566234752:0@lo:400:kworker.0 00000020:00080000:3.0:1787118776.200829:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787118776.200885:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787118776.200902:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1787118776.201606:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:3.0:1787118776.658355:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118776.658384:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118776.658481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118776.658847:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235136 00000100:00100000:0.0:1787118776.658856:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235136 00000100:00100000:0.0:1787118776.658921:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787118776.658930:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118776.658974:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118776.659042:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118776.659049:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787118776.659180:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787118777.107804:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118777.162234:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118777.162359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118777.162601:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235264 00000100:00100000:0.0:1787118777.162612:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235264 00000100:00100000:0.0:1787118777.162687:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787118777.162698:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118777.162778:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118777.162838:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118777.162846:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787118777.163064:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118778.121978:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118779.145878:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787118780.110900:0:12377:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:52:57 (1787118777) 00000100:00100000:1.0:1787118780.122855:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118780.122891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118780.122939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118780.122960:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118780.122982:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203648 00000100:00100000:1.0:1787118780.122995:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118780.123020:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203264 00000100:00100000:1.0:1787118780.123024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203264 00000100:00100000:1.0:1787118780.123071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 301 00000100:00100000:1.0:1787118780.123081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544203264:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118780.123090:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203648 00000100:00100000:3.0:1787118780.123146:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203520 00000100:00100000:1.0:1787118780.123147:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2368:x1873929544203264:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118780.123149:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203520 00000100:00100000:3.0:1787118780.123169:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:1.0:1787118780.123171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 301 00000100:00100000:3.0:1787118780.123176:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544203648:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118780.123204:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:3.0:1787118780.123211:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544203648:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118780.123211:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544203520:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118780.123217:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00080000:3.0:1787118780.123233:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118780.123235:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544203520:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00080000:3.0:1787118780.123237:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118780.123240:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:1.0:1787118780.123255:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203392 00000100:00100000:1.0:1787118780.123258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203392 00000100:00100000:1.0:1787118780.123292:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544203776 00000100:00100000:1.0:1787118780.123295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544203776 00000100:00080000:3.0:1787118780.123297:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118780.123317:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118780.123322:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 157 00000100:00100000:1.0:1787118780.123328:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:2368:x1873929544203392:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118780.123358:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:2368:x1873929544203392:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118780.123365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 157 00000100:00100000:1.0:1787118780.123378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 158 00000100:00100000:1.0:1787118780.123384:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2368:x1873929544203776:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118780.123406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2368:x1873929544203776:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118780.123412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 158 00010000:00010000:3.0:1787118780.170948:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787118780.554567:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118780.554577:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118780.560533:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787118780.560549:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787118781.194282:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118781.261687:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566235520:0@lo:400:kworker.0 00000100:00100000:3.0:1787118781.261823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118781.261907:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566236032:0@lo:400:kworker.0 00000100:00100000:0.0:1787118781.261992:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235776:0@lo:400:kworker.0 00000100:00100000:3.0:1787118781.262002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118781.262032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118781.262058:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787118781.262065:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566235648:0@lo:400:kworker.0 00000100:00100000:3.0:1787118781.262074:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787118781.262084:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566235392:0@lo:400:kworker.0 00000100:00100000:0.0:1787118781.262091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118781.262131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235520 00000100:00100000:0.0:1787118781.262138:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235520 00000100:00100000:0.0:1787118781.262185:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235648 00000100:00100000:0.0:1787118781.262189:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235648 00000100:00100000:3.0:1787118781.262192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118781.262313:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566236032 00000100:00100000:1.0:1787118781.262318:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566236032 00000100:00100000:0.0:1787118781.269218:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787118781.269234:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566235520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118781.269322:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566235520:12345-0@lo:400:kworker.0 Request processed in 92us (7499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118781.269329:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787118781.269345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787118781.269352:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118781.269385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566235648:12345-0@lo:400:kworker.0 Request processed in 34us (7294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118781.269391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787118781.269440:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566235648:0@lo:400:kworker.0 00000100:00100000:0.0:1787118781.270930:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235776 00000100:00100000:0.0:1787118781.270938:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235776 00000100:00100000:1.0:1787118781.271688:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787118781.271700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235392 00000100:00100000:1.0:1787118781.271700:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566236032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118781.271707:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235392 00000100:00100000:2.0:1787118781.271763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787118781.271772:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566235392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118781.271787:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566236032:12345-0@lo:400:kworker.0 Request processed in 89us (9783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118781.271795:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787118781.271815:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566235392:12345-0@lo:400:kworker.0 Request processed in 44us (9649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118781.271821:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787118781.272349:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566235392:0@lo:400:kworker.0 00000100:00100000:2.0:1787118781.272360:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566235904:0@lo:400:kworker.0 00000100:00100000:2.0:1787118781.272391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118781.272430:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566235520:0@lo:400:kworker.0 00000100:00100000:2.0:1787118781.272442:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566236032:0@lo:400:kworker.0 00000100:00100000:1.0:1787118781.272508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566235904 00000100:00100000:1.0:1787118781.272513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566235904 00000100:00100000:1.0:1787118781.272552:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787118781.272560:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566235904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118781.272601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566235904:12345-0@lo:400:kworker.0 Request processed in 41us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118781.272608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787118781.272635:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566235904:0@lo:400:kworker.0 00000100:00100000:1.0:1787118781.274996:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787118781.275097:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118781.275261:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566235776:12345-0@lo:400:kworker.0 Request processed in 253us (13228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118781.278830:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566235776:0@lo:400:kworker.0 00000100:00080000:3.0:1787118781.279329:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118781.279335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118781.279339:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118781.281663:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787118781.770706:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118781.770746:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566236160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118781.770825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118781.771195:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566236160 00000100:00100000:0.0:1787118781.771203:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566236160 00000100:00100000:0.0:1787118781.771251:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787118781.771260:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566236160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118781.771340:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118781.771396:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566236160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118781.771403:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787118781.771588:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566236160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118782.097307:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118782.097776:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204032 00000100:00100000:0.0:1787118782.097786:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204032 00000100:00100000:0.0:1787118782.097888:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 137 00000100:00100000:0.0:1787118782.097899:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:11333:x1873929544204032:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118782.097918:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118782.097990:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8ea3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb09 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098060:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098073:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098086:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098137:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098145:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.098152:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099324:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f8eb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099340:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f8eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099350:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f8eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118782.099373:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787118782.099608:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099617:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099625:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099631:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118782.099636:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099644:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.099656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961351704000) 00010000:00010000:0.0:1787118782.099660:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118782.099663:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787118782.099769:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118782.100443:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030800/0xaa534e3c784f8eaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100468:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100488:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100493:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118782.100495:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100501:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100512:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961351704c00) 00010000:00010000:0.0:1787118782.100514:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118782.100517:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.100523:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f8eb1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.101485:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031c00/0xaa534e3c784f8ea3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb09 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.101506:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f8eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb09 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118782.101514:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:0.0:1787118782.101517:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118782.101519:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81e00, rc 0) 00000100:00100000:0.0:1787118782.101597:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:11333:x1873929544204032:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 3699us (4296us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787118782.101614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 137 00000100:00100000:1.0:1787118782.108280:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118782.111177:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118782.111301:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204288 00000100:00100000:1.0:1787118782.111310:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204288 00000100:00100000:1.0:1787118782.111379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:1.0:1787118782.111401:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+15:2368:x1873929544204288:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118782.111416:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118782.111450:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f8eb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb09 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118782.111469:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:1.0:1787118782.111473:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118782.111524:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:2368:x1873929544204288:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118782.111532:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118782.113708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204160 00000100:00100000:0.0:1787118782.113742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204160 00000100:00100000:0.0:1787118782.113795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 138 00000100:00100000:0.0:1787118782.113805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:11333:x1873929544204160:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787118782.113917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:11333:x1873929544204160:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 Request processed in 112us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118782.113924:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 138 00010000:00010000:0.0:1787118782.218525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118782.281904:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118782.281925:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566236288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118782.282006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118782.282131:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566236288 00000100:00100000:3.0:1787118782.282139:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566236288 00000100:00100000:3.0:1787118782.282189:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787118782.282199:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566236288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118782.282235:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118782.282307:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566236288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118782.282315:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787118782.282625:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566236288:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787118782.603075:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787118782.603089:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787118782.605405:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787118782.605430:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787118783.242032:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118784.207541:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.207661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204416 00000100:00100000:0.0:1787118784.207671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204416 00000100:00100000:0.0:1787118784.207880:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 139 00000100:00100000:0.0:1787118784.207893:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:11375:x1873929544204416:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.207912:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.207965:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb10 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208038:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208060:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208089:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208107:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208115:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208685:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208695:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208703:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208709:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.208714:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208744:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208758:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:0.0:1787118784.208761:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.208766:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208771:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208784:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208804:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208810:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208815:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.208817:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208823:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208830:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961351704900) 00010000:00010000:0.0:1787118784.208833:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.208836:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208840:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8ed4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208883:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8ec6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb10 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:0.0:1787118784.208895:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.208899:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb10 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.208909:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81400, rc 0) 00000100:00100000:0.0:1787118784.208989:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:11375:x1873929544204416:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1098us (1456us total) trans 0 rc 301/301 00000100:00100000:0.0:1787118784.208998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 139 00000100:00080000:3.0:1787118784.209147:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118784.214553:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.214636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204672 00000100:00100000:0.0:1787118784.214651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204672 00000100:00100000:0.0:1787118784.214716:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 140 00000100:00100000:0.0:1787118784.214746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+14:11375:x1873929544204672:12345-192.168.203.10@tcp:36:lfs.0 00010000:00010000:0.0:1787118784.214803:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118784.214830:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030400/0xaa534e3c784f8844 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b949 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.214852:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:0.0:1787118784.214857:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118784.215480:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.215495:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.215513:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.215547:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.215562:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 5 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.215576:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566236416:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118784.215696:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787118784.221019:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.221291:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566236416:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118784.221320:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118784.222099:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204800 00000100:00100000:3.0:1787118784.222114:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204800 00010000:00010000:3.0:1787118784.222189:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 6 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787118784.222239:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118784.222263:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:3.0:1787118784.222277:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2368:x1873929544204800:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118784.222294:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118784.222303:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 6 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223433:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 6 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223470:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340030200/0xaa534e3c784f8e9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb02 expref: 6 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223491:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:3.0:1787118784.223496:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223509:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223518:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.223576:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118784.223617:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.223634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.223663:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.223675:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.223694:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118784.224604:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2368:x1873929544204800:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 2323us (3587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118784.224618:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 61 00000004:00200000:1.0:1787118784.224903:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787118784.224919:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224928:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224935:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224941:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118784.224958:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224966:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224980:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961351704800) 00010000:00010000:1.0:1787118784.224983:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118784.224987:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.224993:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f8edb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118784.225019:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e51b82a6 reply state 0000000051ddb897 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118784.225041:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118784.225128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+15:11375:x1873929544204672:12345-192.168.203.10@tcp:36:lfs.0 Request processed in 10381us (10586us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787118784.225138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 140 00010000:00010000:1.0:1787118784.226891:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226907:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226915:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226922:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118784.226927:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226935:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226958:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96136106b200) 00010000:00010000:1.0:1787118784.226961:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118784.226965:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.226972:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f8ee2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.272553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118784.353631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.353758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544204928 00000100:00100000:1.0:1787118784.353767:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544204928 00000100:00100000:1.0:1787118784.353826:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 141 00000100:00100000:1.0:1787118784.353834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+14:11383:x1873929544204928:12345-192.168.203.10@tcp:101:lctl.0 00010000:00010000:1.0:1787118784.353857:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118784.353876:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb17 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.353932:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.353955:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.353965:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118784.354018:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787118784.354021:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118784.354045:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.354077:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb17 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.354094:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb17 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.354103:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:1.0:1787118784.354106:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787118784.354109:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9e00, rc 0) 00000100:00100000:1.0:1787118784.354164:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+15:11383:x1873929544204928:12345-192.168.203.10@tcp:101:lctl.0 Request processed in 329us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118784.354177:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 141 00000100:00100000:2.0:1787118784.406156:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.406288:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205056 00000100:00100000:0.0:1787118784.406298:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205056 00000100:00100000:0.0:1787118784.406352:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 142 00000100:00100000:0.0:1787118784.406361:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+15:11390:x1873929544205056:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118784.406381:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.406402:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8ef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb1e expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406472:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406486:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406496:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406510:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406517:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406523:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406624:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406649:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406657:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118784.406687:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787118784.406690:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118784.406761:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406774:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406780:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406787:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406793:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.406797:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406804:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406815:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:0.0:1787118784.406818:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.406822:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406838:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406851:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406857:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406863:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406868:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.406871:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406877:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406884:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961351704900) 00010000:00010000:0.0:1787118784.406887:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.406889:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406895:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406922:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb1e expref: 17 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406936:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb1e expref: 16 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.406959:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118784.406961:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787118784.406964:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80600, rc 0) 00000100:00100000:0.0:1787118784.407013:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+16:11390:x1873929544205056:12345-192.168.203.10@tcp:101:bash.0 Request processed in 653us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118784.407020:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 142 00000100:00100000:3.0:1787118784.417235:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.417323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205312 00000100:00100000:1.0:1787118784.417332:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205312 00000100:00100000:1.0:1787118784.417421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 143 00000100:00100000:1.0:1787118784.417431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+16:11390:x1873929544205312:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118784.417449:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118784.417467:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8f13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb25 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417590:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417615:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417626:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417641:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417648:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.417655:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787118784.418167:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787118784.418313:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418327:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418334:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418366:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418373:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418380:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418385:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118784.418389:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418396:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418407:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118784.418409:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118784.418413:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418419:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f8f1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118784.418430:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000797d229a reply state 000000002b91c9e8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118784.418443:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787118784.418468:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8f13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418481:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.418487:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:1.0:1787118784.418489:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118784.418491:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118784.419868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+19:11390:x1873929544205312:12345-192.168.203.10@tcp:101:bash.0 Request processed in 2430us (2632us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787118784.419880:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 143 00010000:00010000:0.0:1787118784.428339:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428357:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428364:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428370:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.428375:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428382:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428398:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96136106b800) 00010000:00010000:0.0:1787118784.428401:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118784.428405:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.428410:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f8f21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118784.432375:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.432609:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205440 00000100:00100000:1.0:1787118784.432619:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205440 00000100:00100000:1.0:1787118784.432699:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:1.0:1787118784.432710:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544205440:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118784.432757:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118784.432777:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb2c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787118784.432803:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787118784.432823:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1787118784.432827:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118784.432837:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.432876:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.432891:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8c00, rc 0) 00000100:00100000:1.0:1787118784.432959:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544205440:12345-192.168.203.10@tcp:101:bash.0 Request processed in 251us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118784.432966:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00080000:2.0:1787118784.433100:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118784.442198:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.442347:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205568 00000100:00100000:0.0:1787118784.442356:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205568 00000100:00100000:0.0:1787118784.442412:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:0.0:1787118784.442422:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:11390:x1873929544205568:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118784.442439:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.442458:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb33 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.442489:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.442498:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118784.442502:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118784.442506:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.442548:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.442562:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.442576:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1873929566236544:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118784.442678:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787118784.450502:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.451118:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1873929566236544:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118784.451168:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.451192:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81400, rc 0) 00000100:00100000:0.0:1787118784.451252:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:11390:x1873929544205568:12345-192.168.203.10@tcp:101:bash.0 Request processed in 8830us (9070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118784.451260:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:1.0:1787118784.451952:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205696 00000100:00100000:1.0:1787118784.451964:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205696 00010000:00010000:1.0:1787118784.452009:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118784.452050:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:1.0:1787118784.452065:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544205696:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118784.452079:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118784.452100:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.452114:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.452138:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079ee0d5d/0xaa534e3c784f8f36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb2c expref: 7 pid: 6704 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.452172:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118784.452177:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118784.452196:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.452207:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.452250:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118784.452265:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566236672:192.168.203.10@tcp:105: 00000100:00100000:1.0:1787118784.452336:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787118784.462026:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566236672:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118784.462054:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118784.462112:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544205696:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 10050us (11618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118784.462123:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:3.0:1787118784.467113:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.467320:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544205952 00000100:00100000:0.0:1787118784.467329:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544205952 00000100:00100000:0.0:1787118784.467384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:0.0:1787118784.467393:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+18:11390:x1873929544205952:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:0.0:1787118784.467814:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:11390:x1873929544205952:12345-192.168.203.10@tcp:35:bash.0 Request processed in 421us (710us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787118784.467823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:3.0:1787118784.578826:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.578985:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544206208 00000100:00100000:0.0:1787118784.578994:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544206208 00000100:00100000:0.0:1787118784.579065:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 144 00000100:00100000:0.0:1787118784.579075:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:11400:x1873929544206208:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.579096:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.579118:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb3a expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118784.579225:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787118784.579364:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb3a expref: 21 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.579395:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:0.0:1787118784.579399:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118784.579404:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb3a expref: 21 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.579426:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80000, rc 0) 00000100:00100000:0.0:1787118784.579487:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+20:11400:x1873929544206208:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 414us (671us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787118784.579494:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 144 00000100:00100000:2.0:1787118784.583881:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.583935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544206464 00000100:00100000:0.0:1787118784.583955:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544206464 00000100:00100000:0.0:1787118784.584019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:0.0:1787118784.584029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+20:11400:x1873929544206464:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118784.584294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+21:11400:x1873929544206464:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 265us (421us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787118784.584302:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:3.0:1787118784.710011:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.710178:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544206592 00000100:00100000:0.0:1787118784.710189:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544206592 00000100:00100000:0.0:1787118784.710257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 145 00000100:00100000:0.0:1787118784.710268:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:11406:x1873929544206592:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.710290:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.710309:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb41 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710373:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710400:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710411:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118784.710478:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787118784.710482:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118784.710510:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710535:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb41 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710552:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb41 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.710560:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118784.710563:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118784.710566:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81200, rc 0) 00000100:00100000:0.0:1787118784.711094:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+22:11406:x1873929544206592:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 825us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118784.711102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 145 00000100:00100000:2.0:1787118784.733354:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.733451:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544206848 00000100:00100000:0.0:1787118784.733460:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544206848 00000100:00100000:0.0:1787118784.733534:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 146 00000100:00100000:0.0:1787118784.733545:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+22:11406:x1873929544206848:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.733565:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.733607:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb48 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.733713:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f8f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.733751:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f8f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.733764:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f8f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118784.733775:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787118784.733898:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb48 expref: 25 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.733916:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f8f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb48 expref: 24 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.733924:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:0.0:1787118784.733927:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118784.733931:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80e00, rc 0) 00000100:00100000:0.0:1787118784.733999:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+24:11406:x1873929544206848:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 457us (655us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787118784.734006:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 146 00000100:00100000:2.0:1787118784.747530:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.747657:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207232 00000100:00100000:1.0:1787118784.747666:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207232 00000100:00100000:3.0:1787118784.747681:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.747759:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:1.0:1787118784.747771:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+24:2371:x1873929544207232:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118784.747788:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118784.747811:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f8f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb48 expref: 24 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.747841:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:1.0:1787118784.747846:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118784.747897:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:2371:x1873929544207232:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 129us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118784.747904:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118784.747965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207104 00000100:00100000:2.0:1787118784.747970:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207104 00000100:00100000:2.0:1787118784.748012:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 147 00000100:00100000:2.0:1787118784.748019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:11406:x1873929544207104:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118784.748038:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118784.748052:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8f75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb4f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.748136:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.748148:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.748158:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118784.748169:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787118784.748297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8f75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb4f expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.748312:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb4f expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.748327:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:2.0:1787118784.748330:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787118784.748332:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:2.0:1787118784.748357:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:11406:x1873929544207104:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 338us (676us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787118784.748363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 147 00000100:00100000:2.0:1787118784.756238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118784.756382:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207360 00000100:00100000:3.0:1787118784.756391:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207360 00000100:00100000:3.0:1787118784.756454:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:3.0:1787118784.756465:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544207360:12345-192.168.203.10@tcp:1:lfs.0 00010000:00010000:3.0:1787118784.756506:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.756525:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.756534:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118784.756538:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118784.756543:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.756613:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.756628:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 6 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118784.756643:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566236800:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118784.757146:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff96135170bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118784.765435:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566236800:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118784.765464:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118784.771086:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118784.771819:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207488 00000100:00100000:3.0:1787118784.771828:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207488 00002000:00100000:3.0:1787118784.771874:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96137aa66d80 x1873929544207488/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:575/0 lens 504/0 e 0 to 0 dl 1787118795 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118784.771885:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137aa66d80 with x1873929544207488 ext(0->12) 00010000:00010000:3.0:1787118784.771893:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 7 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.771908:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 7 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118784.771915:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96137aa66d80 00000100:00100000:3.0:1787118784.771957:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:3.0:1787118784.771968:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544207488:12345-192.168.203.10@tcp:4:lfs.0 00000100:00100000:3.0:1787118784.772864:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544207488:12345-192.168.203.10@tcp:4:lfs.0 Request processed in 894us (1783us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787118784.772883:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00002000:00100000:3.0:1787118784.772892:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff96137aa66d80 x1873929544207488/t4294967305(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:575/0 lens 504/448 e 0 to 0 dl 1787118795 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118784.772900:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137aa66d80 with x1873929544207488 ext(0->12) 00010000:00010000:3.0:1787118784.772906:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.772921:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118784.772930:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96137aa66d80 00000100:00100000:3.0:1787118784.775479:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.775572:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207616 00000100:00100000:0.0:1787118784.775580:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207616 00010000:00010000:0.0:1787118784.775617:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.775756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:0.0:1787118784.775767:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2368:x1873929544207616:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118784.775784:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787118784.775801:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787118784.775804:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787118783 00002000:00010000:0.0:1787118784.775806:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787118783 00002000:00010000:0.0:1787118784.775809:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787118783 00010000:00010000:0.0:1787118784.775815:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.775829:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.775851:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f815f4f2/0xaa534e3c784f8f3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb33 expref: 9 pid: 6705 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.775867:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118784.775871:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118784.775877:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.775887:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.775921:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118784.776045:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776054:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776077:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776085:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776094:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776108:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118784.776112:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776122:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776133:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118784.776140:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4025ed3/0xaa534e3c784f8f8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.776202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544207616:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 436us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118784.776220:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:3.0:1787118784.778173:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544207360:12345-192.168.203.10@tcp:1:lfs.0 Request processed in 21702us (21937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118784.778186:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:2.0:1787118784.783717:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.783797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544207872 00000100:00100000:0.0:1787118784.783807:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544207872 00000100:00100000:0.0:1787118784.783864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:3.0:1787118784.783871:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787118784.783877:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+25:11406:x1873929544207872:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118784.783883:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:0.0:1787118784.783954:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb4f expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118784.784186:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787118784.784255:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787118784.784914:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787118784.784980:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.784995:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.785005:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.785035:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.785048:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 29 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.785062:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566236928:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118784.785146:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118784.789789:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.789937:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544208000 00000100:00100000:1.0:1787118784.789964:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544208000 00010000:00010000:1.0:1787118784.790012:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 30 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118784.790052:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:1.0:1787118784.790061:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350046850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+30:2368:x1873929544208000:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118784.790075:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118784.790081:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 30 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.790093:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 30 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.790114:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:1.0:1787118784.790119:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.790142:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.790150:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118784.790169:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118784.790220:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350046850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+30:2368:x1873929544208000:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 161us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118784.790227:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 64 00010000:00010000:0.0:1787118784.791118:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f8f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb25 expref: 29 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.791136:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566236928:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118784.791155:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.791163:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.791168:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118784.791282:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787118784.791671:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787118784.791971:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566237056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787118784.792162:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118784.792235:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118784.793616:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237056 00000100:00100000:3.0:1787118784.793627:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237056 00000100:00100000:3.0:1787118784.793891:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118784.793976:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566237056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787118784.794108:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566237056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (1946us total) trans 0 rc 0/0 00000100:00080000:2.0:1787118784.794153:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118784.794279:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a80b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566237056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787118784.794781:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787118784.794858:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9613500eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566237184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787118784.794898:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118784.794925:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e8310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118784.795593:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787118784.795603:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787118784.796894:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237184 00000100:00100000:0.0:1787118784.796903:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237184 00000100:00100000:3.0:1787118784.797066:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787118784.797076:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5845:x1873929566237184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787118784.797329:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5845:x1873929566237184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 254us (2430us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787118784.797337:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787118784.797495:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118784.797570:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9613500eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566237184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787118784.797633:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787118784.797677:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797688:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797715:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797750:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118784.797755:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797763:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797778:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:0.0:1787118784.797781:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787118784.797786:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.797793:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787118784.797978:0:5845:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787118784.798086:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787118784.798097:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363955374610ns, next at 364955372621ns, rc = 0 00000001:00080000:0.0:1787118784.798104:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787118784.798135:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96136106bf00) 00010000:00010000:0.0:1787118784.798137:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787118784.798143:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f8f7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb4f expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118784.798232:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:11406:x1873929544207872:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 14359us (14532us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787118784.798250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 38 00000020:00080000:0.0:1787118784.798253:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787118784.801471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.801575:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544208128 00000100:00100000:0.0:1787118784.801583:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544208128 00000100:00100000:0.0:1787118784.801640:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 148 00000100:00100000:0.0:1787118784.801650:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+32:11406:x1873929544208128:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.801671:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.801691:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb56 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.801771:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb56 expref: 33 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.801785:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb56 expref: 33 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.801802:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118784.801805:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118784.801809:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80000, rc 0) 00000100:00100000:0.0:1787118784.801860:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+33:11406:x1873929544208128:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 211us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118784.801867:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 148 00000100:00100000:3.0:1787118784.805491:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118784.805583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544208384 00000100:00100000:1.0:1787118784.805592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544208384 00000100:00100000:1.0:1787118784.805648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:1.0:1787118784.805659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:11406:x1873929544208384:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118784.805921:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+34:11406:x1873929544208384:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 263us (438us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787118784.805928:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:3.0:1787118784.913093:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.913257:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544208640 00000100:00100000:0.0:1787118784.913266:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544208640 00000100:00100000:0.0:1787118784.913326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 149 00000100:00100000:0.0:1787118784.913336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+34:11416:x1873929544208640:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118784.913374:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118784.913393:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb5d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118784.913513:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787118784.913628:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb5d expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.913643:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:0.0:1787118784.913646:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118784.913651:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f8f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb5d expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118784.913665:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81400, rc 0) 00000100:00100000:0.0:1787118784.913761:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+35:11416:x1873929544208640:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 388us (640us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787118784.913768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 149 00000100:00100000:0.0:1787118784.927759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118784.930020:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544208768 00000100:00100000:2.0:1787118784.930032:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544208768 00000100:00100000:2.0:1787118784.930101:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 150 00000100:00100000:2.0:1787118784.930111:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:11416:x1873929544208768:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:2.0:1787118784.930186:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930202:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930215:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930230:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930237:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930259:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930352:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930360:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930367:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118784.930405:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930418:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930424:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930430:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930435:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118784.930438:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930445:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930456:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118784.930465:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118784.930470:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930476:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930490:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930496:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930502:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930507:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118784.930510:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930516:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930523:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96134bc94900) 00010000:00010000:2.0:1787118784.930526:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118784.930528:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930534:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930547:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930558:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930563:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930568:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118784.930571:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930576:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930582:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118784.930584:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118784.930587:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118784.930592:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118784.930673:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:11416:x1873929544208768:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 562us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118784.930681:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 150 00000100:00100000:3.0:1787118784.933012:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118784.933163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209024 00000100:00100000:0.0:1787118784.933172:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209024 00000100:00100000:0.0:1787118784.933226:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:0.0:1787118784.933236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+35:11416:x1873929544209024:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118784.933492:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+36:11416:x1873929544209024:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 256us (488us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787118784.933500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:3.0:1787118785.032381:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118785.032766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209280 00000100:00100000:2.0:1787118785.032777:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209280 00000100:00100000:2.0:1787118785.032842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 151 00000100:00100000:2.0:1787118785.032852:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+36:11419:x1873929544209280:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118785.032876:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118785.032910:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb64 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033021:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033047:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033073:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033081:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033088:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033208:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033217:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033225:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118785.033236:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787118785.033344:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033364:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033371:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033378:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118785.033382:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033390:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033403:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118785.033406:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118785.033411:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033417:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f8fc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033432:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033438:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033445:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033450:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118785.033468:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033476:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033484:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96134bc94900) 00010000:00010000:2.0:1787118785.033486:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118785.033488:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033494:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033548:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033560:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.033567:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118785.033570:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118785.033572:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118785.035913:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+38:11419:x1873929544209280:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 3053us (3533us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787118785.035945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 151 00000100:00100000:3.0:1787118785.040344:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118785.040439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209408 00000100:00100000:1.0:1787118785.040447:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209408 00000100:00100000:1.0:1787118785.040503:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 152 00000100:00100000:1.0:1787118785.040521:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+38:11419:x1873929544209408:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:1.0:1787118785.040598:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040639:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040665:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040672:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040679:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040686:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118785.040691:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040698:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:1.0:1787118785.040712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118785.040717:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.040746:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f8fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118785.040820:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+38:11419:x1873929544209408:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 300us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118785.040833:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 152 00000100:00100000:3.0:1787118785.046477:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118785.046799:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209664 00000100:00100000:2.0:1787118785.046809:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209664 00000100:00100000:2.0:1787118785.046867:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:2.0:1787118785.046877:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+38:11419:x1873929544209664:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118785.047169:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+39:11419:x1873929544209664:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 292us (699us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787118785.047177:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:3.0:1787118785.242501:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.242552:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.242591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.242619:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.242660:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118785.242754:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210048 00000100:00100000:2.0:1787118785.242763:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210048 00000100:00100000:2.0:1787118785.242824:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210176 00000100:00100000:2.0:1787118785.242827:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210176 00000100:00100000:2.0:1787118785.242846:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:2.0:1787118785.242855:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544210048:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118785.242921:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2370:x1873929544210048:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118785.242929:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:2.0:1787118785.242957:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:2.0:1787118785.242964:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544210176:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118785.242988:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544210176:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118785.243006:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:2.0:1787118785.243026:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210304 00000100:00100000:2.0:1787118785.243029:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210304 00000100:00100000:2.0:1787118785.243048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209920 00000100:00100000:2.0:1787118785.243050:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209920 00000100:00100000:2.0:1787118785.243068:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 162 00000100:00100000:2.0:1787118785.243075:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544210304:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118785.243102:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544210304:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118785.243121:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 162 00000100:00100000:2.0:1787118785.243136:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 163 00000100:00100000:2.0:1787118785.243141:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+39:2371:x1873929544209920:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118785.243172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+39:2371:x1873929544209920:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118785.243177:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 163 00000100:00100000:1.0:1787118785.243544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544209792 00000100:00100000:1.0:1787118785.243549:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544209792 00000100:00100000:1.0:1787118785.243590:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 303 00000100:00100000:1.0:1787118785.243597:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544209792:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118785.243631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544209792:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 34us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118785.243638:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 303 00000100:00080000:3.0:1787118785.243982:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787118785.291846:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118785.400534:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118785.400639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210560 00000100:00100000:2.0:1787118785.400648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210560 00000100:00100000:2.0:1787118785.400717:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 153 00000100:00100000:2.0:1787118785.400760:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+39:11450:x1873929544210560:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:2.0:1787118785.400783:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118785.400805:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb6b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.400906:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.400922:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.400933:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118785.400957:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787118785.401089:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f8fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb6b expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.401127:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb6b expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.401136:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118785.401139:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118785.401142:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118785.401213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+41:11450:x1873929544210560:12345-192.168.203.10@tcp:101:cat.0 Request processed in 454us (689us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787118785.401220:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 153 00000100:00100000:3.0:1787118785.411446:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.411494:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118785.411565:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210944 00000100:00100000:0.0:1787118785.411575:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210944 00000100:00100000:0.0:1787118785.411645:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:0.0:1787118785.411655:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+41:2371:x1873929544210944:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118785.411670:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118785.411696:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f8ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb6b expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.411714:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118785.411719:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118785.411810:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+40:2371:x1873929544210944:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 156us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118785.411818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:1.0:1787118785.412038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544210816 00000100:00100000:1.0:1787118785.412043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544210816 00000100:00100000:1.0:1787118785.412081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:1.0:1787118785.412089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+40:11450:x1873929544210816:12345-192.168.203.10@tcp:35:cat.0 00000100:00100000:1.0:1787118785.412283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+41:11450:x1873929544210816:12345-192.168.203.10@tcp:35:cat.0 Request processed in 195us (845us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787118785.412290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:3.0:1787118785.513189:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118785.513284:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544211200 00000100:00100000:1.0:1787118785.513294:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544211200 00000100:00100000:1.0:1787118785.513363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 154 00000100:00100000:1.0:1787118785.513373:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+41:11456:x1873929544211200:12345-192.168.203.10@tcp:101:dd.0 00010000:00010000:1.0:1787118785.513400:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118785.513413:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787118785.513439:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f8f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb41 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513476:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118785.513480:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118785.513496:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9001 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb72 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513591:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513605:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513613:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513644:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.513658:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 41 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118785.513671:0:5842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566237312:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118785.513807:0:5842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118785.516584:0:5842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1873929566237312:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118785.516615:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118785.518330:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118785.518453:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544211328 00000100:00100000:1.0:1787118785.518462:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544211328 00010000:00010000:1.0:1787118785.518502:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118785.518564:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 65 00000100:00100000:1.0:1787118785.518574:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+42:2368:x1873929544211328:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118785.518588:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118785.518594:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518605:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518627:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f8fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb64 expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518641:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:1.0:1787118785.518646:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518655:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518662:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.518689:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118785.518779:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+41:2368:x1873929544211328:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 207us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118785.518787:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 65 00010000:00010000:2.0:1787118785.518967:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.518976:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118785.518995:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787118785.519141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9001 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.519157:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.519164:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118785.519174:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118785.519177:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9a00, rc 0) 00000100:00100000:2.0:1787118785.519214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+41:11456:x1873929544211200:12345-192.168.203.10@tcp:101:dd.0 Request processed in 5843us (6036us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787118785.519220:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 154 00000100:00100000:3.0:1787118785.533422:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118785.533562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544211584 00000100:00100000:2.0:1787118785.533571:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544211584 00000100:00100000:2.0:1787118785.533631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 155 00000100:00100000:2.0:1787118785.533641:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+41:11456:x1873929544211584:12345-192.168.203.10@tcp:36:dd.0 00010000:00010000:2.0:1787118785.533950:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.533966:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.533977:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118785.534043:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787118785.534069:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6feccbe reply state 00000000c44a4a32 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118785.534077:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118785.534162:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+44:11456:x1873929544211584:12345-192.168.203.10@tcp:36:dd.0 Request processed in 522us (759us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787118785.534169:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 155 00000020:00080000:2.0:1787118785.534174:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787118785.537400:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537426:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537450:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537458:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118785.537462:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537470:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537485:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118785.537488:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118785.537492:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118785.537498:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9016 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118785.874985:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118785.876407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544211712 00000100:00100000:0.0:1787118785.876420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544211712 00000100:00100000:0.0:1787118785.876517:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 156 00000100:00100000:0.0:1787118785.876528:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+43:11470:x1873929544211712:12345-192.168.203.10@tcp:101:stat.0 00010000:00010000:0.0:1787118785.876551:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118785.876571:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f901d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb79 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876634:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876648:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876661:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876687:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876695:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876702:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876820:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876831:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876839:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876872:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.876886:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 44 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118785.876900:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566237440:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118785.877021:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118785.883027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118785.883178:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544211968 00000100:00100000:3.0:1787118785.883187:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544211968 00000100:00100000:3.0:1787118785.883241:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:3.0:1787118785.883257:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+45:9983:x1873929544211968:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787118785.883636:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:9983:x1873929544211968:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 379us (618us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787118785.883645:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:0.0:1787118785.886300:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566237440:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118785.886334:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118785.900034:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118785.900241:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544212096 00000100:00100000:0.0:1787118785.900251:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544212096 00010000:00010000:0.0:1787118785.900288:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 46 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118785.900331:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 66 00000100:00100000:0.0:1787118785.900340:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:2368:x1873929544212096:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118785.900355:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118785.900361:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 46 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900374:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 46 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900395:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9008 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb72 expref: 46 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900421:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118785.900426:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900435:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900441:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118785.900598:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118785.900668:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+45:2368:x1873929544212096:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 329us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118785.900676:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 66 00010000:00010000:1.0:1787118785.901756:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118785.901815:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787118785.901820:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118785.901843:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901866:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901872:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901879:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901885:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118785.901889:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901896:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.901908:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118785.901910:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118785.902007:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902028:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902035:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902040:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902046:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118785.902049:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902055:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902281:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704100) 00010000:00010000:1.0:1787118785.902284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118785.902287:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f902b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902338:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f901d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb79 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902365:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb79 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118785.902373:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:1.0:1787118785.902375:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118785.902378:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81a00, rc 0) 00000100:00100000:1.0:1787118785.902619:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+44:11470:x1873929544211712:12345-192.168.203.10@tcp:101:stat.0 Request processed in 26091us (27642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118785.902628:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 156 00000100:00100000:1.0:1787118786.018681:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118786.018779:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544212352 00000100:00100000:2.0:1787118786.018798:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544212352 00000100:00100000:2.0:1787118786.018869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 157 00000100:00100000:2.0:1787118786.018881:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+44:11476:x1873929544212352:12345-192.168.203.10@tcp:36:truncate.0 00010000:00010000:2.0:1787118786.018954:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118786.018982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f9032 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb79 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787118786.019314:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787118786.019408:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118786.019413:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118786.019620:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.019647:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.019657:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118786.019709:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787118786.019779:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c1f3fb1 reply state 000000009142fcd1 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118786.019788:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118786.019878:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+46:11476:x1873929544212352:12345-192.168.203.10@tcp:36:truncate.0 Request processed in 998us (1205us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787118786.019885:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 157 00000020:00080000:2.0:1787118786.019890:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787118786.029559:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029576:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029584:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029590:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.029595:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029603:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029620:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.029623:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.029628:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.029634:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118786.271536:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118786.271679:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544212480 00000100:00100000:2.0:1787118786.271689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544212480 00000100:00100000:2.0:1787118786.271777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 158 00000100:00100000:2.0:1787118786.271787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+45:11490:x1873929544212480:12345-192.168.203.10@tcp:101:stat.0 00010000:00010000:2.0:1787118786.271811:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118786.271831:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9040 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb80 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271895:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271908:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271918:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271958:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271965:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.271971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272062:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272071:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272078:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118786.272111:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787118786.272115:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118786.272134:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272144:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272152:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272159:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272177:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272184:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118786.272188:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272196:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272208:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118786.272211:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118786.272215:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272221:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272235:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272241:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272247:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272251:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118786.272254:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272269:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272277:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96134bc94500) 00010000:00010000:2.0:1787118786.272279:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118786.272282:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272287:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f904e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272318:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9040 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272331:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.272338:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118786.272340:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118786.272342:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118786.272518:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+46:11490:x1873929544212480:12345-192.168.203.10@tcp:101:stat.0 Request processed in 731us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118786.272526:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 158 00010000:00010000:0.0:1787118786.319191:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118786.380339:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566237568:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.380683:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566238080:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.380761:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787118786.380767:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566237696:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.380831:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566238208:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380859:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.380894:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566237824:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.380960:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118786.380968:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566237952:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.380997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118786.381043:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566238208 00000100:00100000:3.0:1787118786.381050:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566238208 00000100:00100000:3.0:1787118786.381110:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237952 00000100:00100000:3.0:1787118786.381114:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237952 00000100:00100000:3.0:1787118786.381148:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118786.381158:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566238208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381240:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566238208:12345-0@lo:400:kworker.0 Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381247:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787118786.381264:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787118786.381271:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566237952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381303:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566237952:12345-0@lo:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381308:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787118786.381327:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118786.381330:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118786.381356:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566237952:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381390:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566238208:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381414:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566238080 00000100:00100000:3.0:1787118786.381418:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566238080 00000100:00100000:3.0:1787118786.381446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237696 00000100:00100000:3.0:1787118786.381449:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237696 00000100:00100000:3.0:1787118786.381461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237824 00000100:00100000:3.0:1787118786.381463:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237824 00000100:00100000:3.0:1787118786.381477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787118786.381484:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566238080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566238080:12345-0@lo:400:kworker.0 Request processed in 36us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381527:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787118786.381540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787118786.381546:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566237696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381572:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566237696:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787118786.381598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787118786.381603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566237824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381637:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566237824:12345-0@lo:400:kworker.0 Request processed in 33us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1787118786.381660:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118786.381685:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566237824:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381742:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566237696:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381760:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566238080:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566237568 00000100:00100000:3.0:1787118786.381821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566237568 00000100:00100000:3.0:1787118786.381857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787118786.381865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.381906:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566237568:12345-0@lo:400:kworker.0 Request processed in 42us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.381914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787118786.381966:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566237568:0@lo:400:kworker.0 00000100:00100000:3.0:1787118786.404183:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.404380:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544212736 00000100:00100000:3.0:1787118786.404390:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544212736 00000100:00100000:3.0:1787118786.404509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 159 00000100:00100000:3.0:1787118786.404519:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+46:11500:x1873929544212736:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118786.404555:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118786.404576:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f905c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118786.404950:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787118786.405379:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f905c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb87 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.405464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:3.0:1787118786.405469:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118786.405475:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f905c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb87 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.405490:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d400, rc 0) 00000100:00100000:3.0:1787118786.405557:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+47:11500:x1873929544212736:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1039us (1382us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787118786.405565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 159 00000100:00100000:3.0:1787118786.407946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.407976:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544212992 00000100:00100000:3.0:1787118786.407993:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544212992 00000100:00100000:3.0:1787118786.408037:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:3.0:1787118786.408047:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+47:11500:x1873929544212992:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118786.408662:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+48:11500:x1873929544212992:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 614us (720us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787118786.408671:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 44 00000001:00080000:0.0:1787118786.456385:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:0.0:1787118786.456417:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1787118786.456457:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000001:00080000:0.0:1787118786.456469:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000020:00080000:0.0:1787118786.456514:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9613507e1e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787118786.456519:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961375c79f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9613507e1540 00000020:00080000:0.0:1787118786.456522:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961375c79b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96137a835000 00000020:00080000:3.0:1787118786.456833:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787118786.457018:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787118786.457055:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566238336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787118786.457123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118786.469876:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566238336 00000100:00100000:1.0:1787118786.469889:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566238336 00000100:00100000:0.0:1787118786.470053:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787118786.470064:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566238336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787118786.470095:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787118786.470131:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8544bf, atime: 0x6a8544bf, ctime: 0x6a8544bf, blocks: 0x1 00010000:00010000:0.0:1787118786.470147:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.470164:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1787118786.470168:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118786.470175:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.470191:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.470200:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.470208:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.470238:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787118786.470821:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566238336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 758us (13695us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787118786.470835:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787118786.471066:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118786.471072:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.471080:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118786.471085:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.471093:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.471109:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.471126:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b33e5c7/0xaa534e3c784f906a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.471154:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118786.471156:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118786.471157:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787118786.472104:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96137aa65880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787118786.472116:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566238336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787118786.490776:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.490965:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544213248 00000100:00100000:0.0:1787118786.490975:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544213248 00000100:00100000:0.0:1787118786.491032:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 160 00000100:00100000:0.0:1787118786.491043:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+18:11506:x1873929544213248:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118786.491067:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118786.491088:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f9071 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb8e expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.491193:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.491208:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.491216:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.491248:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.491260:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 19 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118786.491273:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566238464:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118786.491425:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787118786.496531:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118786.497555:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544213376 00000100:00100000:1.0:1787118786.497567:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544213376 00010000:00010000:1.0:1787118786.497617:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118786.497655:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:1.0:1787118786.497665:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+20:2368:x1873929544213376:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118786.497679:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118786.497686:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.497700:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 20 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.497754:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:1.0:1787118786.497760:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.497769:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.497795:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.497814:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118786.497872:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+20:2368:x1873929544213376:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 206us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118786.497880:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00010000:00010000:0.0:1787118786.498688:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb80 expref: 19 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118786.498717:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566238464:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118786.498776:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.498785:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.498791:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118786.498810:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787118786.498957:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f9071 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 20 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.498972:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 19 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.498982:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.498985:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787118786.498988:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80a00, rc 0) 00000100:00100000:0.0:1787118786.499142:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:11506:x1873929544213248:12345-192.168.203.10@tcp:101:bash.0 Request processed in 8092us (8366us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787118786.499150:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 160 00000100:00100000:3.0:1787118786.510313:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.510407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544213632 00000100:00100000:0.0:1787118786.510416:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544213632 00000100:00100000:0.0:1787118786.510475:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 161 00000100:00100000:0.0:1787118786.510485:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:11506:x1873929544213632:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:0.0:1787118786.510829:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.510846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.510859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118786.510917:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787118786.510952:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000078ff87c reply state 000000006ba1be08 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118786.510960:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787118786.511038:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+22:11506:x1873929544213632:12345-192.168.203.10@tcp:36:bash.0 Request processed in 554us (734us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787118786.511046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 161 00000020:00080000:0.0:1787118786.511050:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787118786.515403:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515437:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515445:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515452:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118786.515457:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515465:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515482:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118786.515485:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118786.515489:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.515494:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f9086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118786.517992:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118786.518081:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544213760 00000100:00100000:2.0:1787118786.518091:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544213760 00000100:00100000:2.0:1787118786.518149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 162 00000100:00100000:2.0:1787118786.518159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+21:11506:x1873929544213760:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118786.518183:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118786.518202:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f908d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb95 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.518277:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.518314:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 22 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.518323:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.518356:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 22 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.518368:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 22 pid: 7892 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118786.518381:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566238592:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118786.518466:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787118786.522240:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.522310:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544213888 00000100:00100000:0.0:1787118786.522319:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544213888 00010000:00010000:0.0:1787118786.522358:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 23 pid: 7892 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118786.522402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:0.0:1787118786.522411:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+23:2369:x1873929544213888:12345-192.168.203.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787118786.522412:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137aa64700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566238592:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118786.522425:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118786.522431:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 23 pid: 7892 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.522437:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522462:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 23 pid: 7892 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522485:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f9078 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb8e expref: 23 pid: 7892 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522500:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.522505:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522514:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522522:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.522550:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118786.522593:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.522601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118786.522645:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787118786.522649:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118786.522666:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.522704:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f908d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb95 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.522718:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb95 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118786.522771:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:2.0:1787118786.522774:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118786.522777:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987600, rc 0) 00000100:00100000:2.0:1787118786.522823:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:11506:x1873929544213760:12345-192.168.203.10@tcp:101:bash.0 Request processed in 4665us (4847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118786.522830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 162 00000100:00100000:0.0:1787118786.523398:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+21:2369:x1873929544213888:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 986us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118786.523407:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:3.0:1787118786.527013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118786.527104:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544214144 00000100:00100000:1.0:1787118786.527113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544214144 00000100:00100000:1.0:1787118786.527179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:1.0:1787118786.527189:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+21:11506:x1873929544214144:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:1.0:1787118786.527436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:11506:x1873929544214144:12345-192.168.203.10@tcp:35:bash.0 Request processed in 247us (431us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787118786.527444:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:2.0:1787118786.609409:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.610658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544214400 00000100:00100000:0.0:1787118786.610670:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544214400 00000100:00100000:0.0:1787118786.610770:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 163 00000100:00100000:0.0:1787118786.610781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+22:11516:x1873929544214400:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118786.610806:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118786.610828:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f909b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bb9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118786.611086:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787118786.611232:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f909b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb9c expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.611245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:0.0:1787118786.611248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118786.611253:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f909b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb9c expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.611266:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80a00, rc 0) 00000100:00100000:0.0:1787118786.611342:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+23:11516:x1873929544214400:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 562us (1941us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787118786.611349:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 163 00000100:00100000:2.0:1787118786.616889:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.617001:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544214528 00000100:00100000:0.0:1787118786.617010:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544214528 00000100:00100000:0.0:1787118786.617092:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 164 00000100:00100000:0.0:1787118786.617101:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:11516:x1873929544214528:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:0.0:1787118786.617182:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617197:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617207:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617221:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617240:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617246:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617614:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617624:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617642:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118786.617683:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617695:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617702:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617709:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617715:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.617719:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617749:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617769:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118786.617771:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.617776:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617782:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617795:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617800:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617806:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617811:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.617814:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617820:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617826:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704c00) 00010000:00010000:0.0:1787118786.617828:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.617831:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617837:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617858:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617864:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617870:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617874:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.617877:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617883:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617889:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.617891:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.617893:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.617899:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118786.617983:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:11516:x1873929544214528:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 882us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118786.617991:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 164 00000100:00100000:2.0:1787118786.620867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.620980:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544214784 00000100:00100000:3.0:1787118786.621126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544214784 00000100:00100000:3.0:1787118786.621260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:3.0:1787118786.621274:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+23:11516:x1873929544214784:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118786.621906:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11516:x1873929544214784:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 632us (1044us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787118786.621918:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:1.0:1787118786.681652:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.681907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215040 00000100:00100000:0.0:1787118786.681917:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215040 00000100:00100000:0.0:1787118786.681983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 165 00000100:00100000:0.0:1787118786.682013:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+24:11519:x1873929544215040:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118786.682035:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118786.682057:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bba3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682128:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682325:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682337:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682352:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682359:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682365:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682780:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682789:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.682796:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118786.682815:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787118786.683271:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683281:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683288:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683295:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.683299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683306:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683318:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118786.683322:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.683326:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683332:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f90c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683345:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683350:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683367:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683372:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118786.683375:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683381:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683389:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704c00) 00010000:00010000:0.0:1787118786.683391:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118786.683394:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683399:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80200/0xaa534e3c784f90cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f90be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bba3 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683469:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bba3 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.683477:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.683479:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118786.683481:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80a00, rc 0) 00000100:00100000:0.0:1787118786.684043:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+26:11519:x1873929544215040:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 2031us (2398us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787118786.684063:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 165 00000100:00100000:2.0:1787118786.691582:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118786.691677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.691770:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215296 00000100:00100000:0.0:1787118786.691780:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215296 00000100:00100000:0.0:1787118786.691854:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118786.691865:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+26:2368:x1873929544215296:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118786.691879:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118786.691903:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bba3 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.691942:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:0.0:1787118786.691947:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118786.692014:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:2368:x1873929544215296:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 151us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118786.692021:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:3.0:1787118786.693284:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215168 00000100:00100000:3.0:1787118786.693294:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215168 00000100:00100000:3.0:1787118786.694280:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 166 00000100:00100000:3.0:1787118786.694292:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:11519:x1873929544215168:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:3.0:1787118786.694377:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694393:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694416:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694468:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694474:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694481:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118786.694485:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694492:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694502:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:3.0:1787118786.694505:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118786.694509:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.694515:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118786.694634:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:11519:x1873929544215168:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 344us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118786.694642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 166 00000100:00100000:2.0:1787118786.701451:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.701544:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215552 00000100:00100000:3.0:1787118786.701553:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215552 00000100:00100000:3.0:1787118786.701608:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:3.0:1787118786.701632:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+25:11519:x1873929544215552:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118786.703807:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+26:11519:x1873929544215552:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 2168us (2481us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787118786.703820:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:3.0:1787118786.890547:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566238720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118786.890630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118786.890867:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566238720 00000100:00100000:1.0:1787118786.890874:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566238720 00000100:00100000:1.0:1787118786.890957:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787118786.890967:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566238720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787118786.891000:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787118786.895766:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566238720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4791us (5126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118786.895781:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787118786.903621:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566238720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118786.903851:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.904507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215808 00000100:00100000:3.0:1787118786.904516:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215808 00000100:00100000:3.0:1787118786.904663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:3.0:1787118786.904674:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+26:11537:x1873929544215808:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:3.0:1787118786.904697:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118786.904718:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbaa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.904845:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f90ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.904859:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f90ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.904871:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f90ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118786.904881:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787118786.905030:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f90e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbaa expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.905072:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f90ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbaa expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.905080:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:3.0:1787118786.905083:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787118786.905085:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c600, rc 0) 00000100:00100000:3.0:1787118786.905152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+28:11537:x1873929544215808:12345-192.168.203.10@tcp:101:cat.0 Request processed in 480us (1303us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787118786.905159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:2.0:1787118786.943633:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.943792:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544215936 00000100:00100000:0.0:1787118786.943803:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544215936 00000100:00100000:0.0:1787118786.943906:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 168 00000100:00100000:0.0:1787118786.943917:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+28:11538:x1873929544215936:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118786.943947:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118786.943987:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbb1 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944055:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944069:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944097:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118786.944280:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787118786.944284:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118786.944652:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944682:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f90fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb1 expref: 30 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944699:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb1 expref: 29 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.944708:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118786.944711:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118786.944714:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81400, rc 0) 00000100:00100000:0.0:1787118786.944831:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:11538:x1873929544215936:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 916us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118786.944838:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 168 00000100:00100000:2.0:1787118786.951909:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.952010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216320 00000100:00100000:3.0:1787118786.952019:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216320 00000100:00100000:3.0:1787118786.952073:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:3.0:1787118786.952084:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+29:11538:x1873929544216320:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:3.0:1787118786.952434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+30:11538:x1873929544216320:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 351us (534us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787118786.952442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:2.0:1787118786.955228:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118786.955313:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216448 00000100:00100000:1.0:1787118786.955321:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216448 00000100:00100000:1.0:1787118786.955377:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:1.0:1787118786.955405:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350044050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+30:11538:x1873929544216448:12345-192.168.203.10@tcp:103:lfs.0 00010000:00010000:1.0:1787118786.955419:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787118786.955443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9094 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb95 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.955463:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f90ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbaa expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.955475:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80000/0xaa534e3c784f8f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb56 expref: 28 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118786.955485:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704900) 00010000:00010000:1.0:1787118786.955493:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118786.955543:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350044050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:11538:x1873929544216448:12345-192.168.203.10@tcp:103:lfs.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118786.955550:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:1.0:1787118786.958712:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118786.958821:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216576 00000100:00100000:0.0:1787118786.958830:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216576 00000100:00100000:0.0:1787118786.958888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 169 00000100:00100000:0.0:1787118786.958898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:11538:x1873929544216576:12345-192.168.203.10@tcp:58:lfs.0 00010000:00010000:0.0:1787118786.959039:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.959055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118786.959072:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787118786.959594:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787118786.959866:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:11538:x1873929544216576:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 967us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118786.959876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 169 00000100:00100000:2.0:1787118786.980183:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118786.980335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216704 00000100:00100000:3.0:1787118786.980345:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216704 00000100:00100000:3.0:1787118786.980501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 170 00000100:00100000:3.0:1787118786.980513:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+27:11540:x1873929544216704:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118786.980532:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118786.980552:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbb8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980617:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980654:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980670:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980677:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.980684:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981086:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981096:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981104:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118786.981138:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787118786.981142:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118786.981160:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981172:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981191:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981197:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981204:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981210:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118786.981214:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981220:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981232:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:3.0:1787118786.981235:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118786.981240:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981246:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d800/0xaa534e3c784f9119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981259:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981265:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981271:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981283:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118786.981286:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981293:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981302:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961359bc8c00) 00010000:00010000:3.0:1787118786.981305:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118786.981308:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981314:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981361:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118786.981369:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:3.0:1787118786.981371:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787118786.981374:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042600, rc 0) 00000100:00100000:2.0:1787118786.981906:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+28:11540:x1873929544216704:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1392us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118786.981915:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 170 00010000:00010000:0.0:1787118787.337976:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118787.403234:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566238848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118787.403313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118787.404013:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566238848 00000100:00100000:2.0:1787118787.404020:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566238848 00000100:00100000:2.0:1787118787.404072:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787118787.404083:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566238848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118787.404115:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118787.404168:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566238848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118787.404175:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787118787.404218:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566238848:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787118787.665862:0:12527:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118787.665870:0:12527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118787.665918:0:12527:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787118787.665933:0:12527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787118787.721945:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118787.721955:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118787.722000:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787118787.722007:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118787.722368:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566238976:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787118787.722581:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118787.738440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.738520:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216832 00000100:00100000:0.0:1787118787.738528:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216832 00000100:00100000:0.0:1787118787.738585:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:0.0:1787118787.738595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544216832:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787118787.738626:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787118787.738746:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544216832:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 126us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118787.738755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:3.0:1787118787.739084:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961350006680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566238976:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787118787.743580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.743831:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544216960 00000100:00100000:3.0:1787118787.743841:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544216960 00000100:00100000:3.0:1787118787.743897:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00100000:3.0:1787118787.743917:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+28:11552:x1873929544216960:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.744045:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.744062:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.744074:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.744104:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.744112:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.744120:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745451:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745471:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745481:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118787.745528:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787118787.745547:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118787.745562:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745577:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745583:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745590:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745596:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118787.745601:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745608:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745621:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:3.0:1787118787.745624:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118787.745628:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745634:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f912e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745649:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745655:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745671:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745676:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118787.745679:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745686:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745694:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff961359bc8d00) 00010000:00010000:3.0:1787118787.745696:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118787.745699:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745705:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f9135 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745737:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745744:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745749:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745754:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118787.745757:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745773:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745782:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:3.0:1787118787.745784:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118787.745787:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.745793:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f913c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.745886:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+28:11552:x1873929544216960:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 Request processed in 1977us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118787.745896:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00100000:3.0:1787118787.749820:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.749952:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544217216 00000100:00100000:0.0:1787118787.749961:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544217216 00000100:00100000:0.0:1787118787.750018:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 173 00000100:00100000:0.0:1787118787.750028:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+28:11552:x1873929544217216:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118787.750047:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118787.750067:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9143 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbbf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750171:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750186:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750376:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118787.750398:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787118787.750496:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750505:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750512:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750518:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118787.750522:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750529:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750543:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:0.0:1787118787.750546:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118787.750550:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750566:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f914a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750606:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9143 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbbf expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750617:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:0.0:1787118787.750619:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118787.750623:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9143 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbbf expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.750631:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80400, rc 0) 00000100:00100000:0.0:1787118787.750848:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217216:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 820us (1037us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787118787.750856:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 173 00000100:00100000:3.0:1787118787.760873:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.761012:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544217344 00000100:00100000:0.0:1787118787.761021:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544217344 00000100:00100000:0.0:1787118787.761078:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 174 00000100:00100000:0.0:1787118787.761089:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217344:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787118787.761123:0:7892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787118787.761233:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217344:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 146us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118787.761241:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 174 00000100:00100000:2.0:1787118787.769515:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.769793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544217600 00000100:00100000:3.0:1787118787.769803:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544217600 00000100:00100000:3.0:1787118787.769858:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 175 00000100:00100000:3.0:1787118787.769869:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217600:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.769888:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118787.769892:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787118787.769927:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb1 expref: 29 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.769946:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:3.0:1787118787.769950:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118787.769973:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9158 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbc6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787118787.771017:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787118787.771557:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382043200/0xaa534e3c784f915f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.771573:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382043200/0xaa534e3c784f915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.771584:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382043200/0xaa534e3c784f915f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.771644:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9158 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbc6 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.771663:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382043200/0xaa534e3c784f915f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbc6 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.771671:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8800) 00010000:00010000:3.0:1787118787.771673:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118787.771676:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382043200, rc 0) 00000100:00100000:3.0:1787118787.772093:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+30:11552:x1873929544217600:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 2223us (2585us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787118787.772102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 175 00000100:00100000:3.0:1787118787.780181:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118787.780546:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544217856 00000100:00100000:1.0:1787118787.780555:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544217856 00000100:00100000:1.0:1787118787.780609:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:1.0:1787118787.780620:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+30:11552:x1873929544217856:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787118787.780685:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118787.780710:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382043200/0xaa534e3c784f915f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbc6 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780750:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8800) 00010000:00010000:1.0:1787118787.780761:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118787.780781:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780795:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780805:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780819:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780827:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.780833:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781331:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781340:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781346:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781358:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118787.781364:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781371:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781380:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118787.781476:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118787.781481:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781487:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f916d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781499:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781504:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781511:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781516:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118787.781519:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781525:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781544:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5f8884 (ffff96136106b000) 00010000:00010000:1.0:1787118787.781546:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118787.781549:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.781555:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5f8884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118787.784632:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217856:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 4002us (4448us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118787.784645:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:1.0:1787118787.793564:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.796086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544217984 00000100:00100000:3.0:1787118787.796099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544217984 00000100:00100000:3.0:1787118787.796202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00100000:3.0:1787118787.796213:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:11552:x1873929544217984:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.796239:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118787.796261:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f917b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbcd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.796296:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.796309:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.796320:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.798038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f917b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.798064:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.798073:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:3.0:1787118787.798076:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787118787.798080:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042400, rc 0) 00000100:00100000:3.0:1787118787.798151:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+30:11552:x1873929544217984:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 1939us (4595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118787.798159:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00100000:1.0:1787118787.809288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118787.809356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544218240 00000100:00100000:2.0:1787118787.809366:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544218240 00000100:00100000:2.0:1787118787.809430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 178 00000100:00100000:2.0:1787118787.809440:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+30:11552:x1873929544218240:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787118787.809522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.809539:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.809551:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118787.809885:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787118787.809896:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366967173583ns, next at 367967170933ns, rc = 0 00000004:00010000:2.0:1787118787.810002:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000289bc647 reply state 000000002689f406 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118787.810022:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118787.810121:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11552:x1873929544218240:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 681us (840us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787118787.810129:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 178 00000100:00100000:1.0:1787118787.818269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118787.818313:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544218368 00000100:00100000:1.0:1787118787.818322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544218368 00000100:00100000:1.0:1787118787.818370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 179 00000100:00100000:1.0:1787118787.818380:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:11552:x1873929544218368:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787118787.818402:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118787.818422:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbd4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.818483:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.818497:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118787.818531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:1.0:1787118787.818535:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118787.818539:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9c00, rc 0) 00000100:00100000:1.0:1787118787.818595:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+33:11552:x1873929544218368:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 216us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118787.818602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 179 00010000:00010000:3.0:1787118787.818865:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818874:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818890:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818896:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118787.818900:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818927:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818940:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:3.0:1787118787.818943:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787118787.818946:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.818951:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f9189 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118787.821771:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.821895:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544218496 00000100:00100000:3.0:1787118787.821914:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544218496 00000100:00100000:3.0:1787118787.822027:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:3.0:1787118787.822037:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544218496:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787118787.822382:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544218496:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 346us (617us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787118787.822390:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00080000:2.0:1787118787.822791:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118787.826433:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.827128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544218752 00000100:00100000:3.0:1787118787.827138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544218752 00000100:00100000:3.0:1787118787.827771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:3.0:1787118787.827783:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11552:x1873929544218752:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787118787.828035:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:11552:x1873929544218752:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 253us (1610us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787118787.828043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:1.0:1787118787.838486:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118787.838551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219008 00000100:00100000:2.0:1787118787.838561:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219008 00000100:00100000:2.0:1787118787.838616:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 180 00000100:00100000:2.0:1787118787.838626:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:11552:x1873929544219008:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787118787.838749:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+33:11552:x1873929544219008:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118787.838757:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 180 00000100:00100000:2.0:1787118787.845429:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118787.845473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219136 00000100:00100000:2.0:1787118787.845482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219136 00000100:00100000:2.0:1787118787.845532:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 181 00000100:00100000:2.0:1787118787.845542:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+33:11552:x1873929544219136:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118787.845561:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118787.845580:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbdb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.845648:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.845663:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.846306:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118787.846347:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118787.846366:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.846396:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbdb expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.846422:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbdb expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.846432:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:2.0:1787118787.846435:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118787.846439:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986800, rc 0) 00000100:00100000:2.0:1787118787.846538:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+34:11552:x1873929544219136:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 996us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118787.846545:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 181 00000100:00100000:0.0:1787118787.861080:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.861113:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219264 00000100:00100000:0.0:1787118787.861122:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219264 00000100:00100000:0.0:1787118787.861178:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:0.0:1787118787.861188:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544219264:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118787.861206:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118787.861225:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbe2 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118787.861251:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8544c2, blocks: 0x1 00010000:00010000:0.0:1787118787.861269:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787118787.861274:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118787.861283:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.861303:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.861318:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80e00, rc 0) 00000100:00100000:0.0:1787118787.861371:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544219264:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 184us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118787.861378:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:3.0:1787118787.872276:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.872480:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219520 00000100:00100000:0.0:1787118787.872489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219520 00000100:00100000:0.0:1787118787.872544:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 182 00000100:00100000:0.0:1787118787.872553:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+34:11552:x1873929544219520:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787118787.872650:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+34:11552:x1873929544219520:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118787.872658:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 182 00000100:00100000:3.0:1787118787.876477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.876509:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219648 00000100:00100000:3.0:1787118787.876519:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219648 00000100:00100000:3.0:1787118787.876562:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:3.0:1787118787.876571:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:11552:x1873929544219648:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.876588:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118787.876605:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbe9 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.876634:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.876644:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118787.876648:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118787.876653:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.876684:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.876697:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 9 pid: 6704 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.876742:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566239104:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118787.876821:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342a349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118787.879591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.879622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219776 00000100:00100000:3.0:1787118787.879630:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219776 00010000:00010000:3.0:1787118787.879667:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 10 pid: 6704 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.879704:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:3.0:1787118787.879713:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+10:2368:x1873929544219776:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118787.879743:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118787.879764:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 10 pid: 6704 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.879778:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 10 pid: 6704 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.879804:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118787.879808:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118787.879816:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 10 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.879825:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 10 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.879875:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 10 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.879890:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1873929566239232:192.168.203.10@tcp:105: 00000100:00100000:3.0:1787118787.879968:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cbb40 going to sleep for 11 seconds 00010000:00010000:3.0:1787118787.880018:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f91a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe2 expref: 10 pid: 6704 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.880032:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566239104:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118787.880056:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.880065:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042c00, rc 0) 00000100:00100000:3.0:1787118787.880090:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+9:11552:x1873929544219648:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 3521us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118787.880097:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:3.0:1787118787.882876:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1873929566239232:192.168.203.10@tcp:105: 00010000:00010000:3.0:1787118787.882899:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118787.882959:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544219776:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 3246us (3375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118787.882969:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:3.0:1787118787.887463:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118787.887738:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544219904 00000100:00100000:1.0:1787118787.887749:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544219904 00002000:00100000:1.0:1787118787.887797:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96136e5b0e00 x1873929544219904/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:578/0 lens 504/0 e 0 to 0 dl 1787118798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787118787.887808:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e5b0e00 with x1873929544219904 ext(0->8) 00002000:00010000:1.0:1787118787.887814:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e5b0e00 00000100:00100000:1.0:1787118787.887841:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:1.0:1787118787.887850:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544219904:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787118787.888561:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+10:2368:x1873929544219904:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 Request processed in 709us (1103us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787118787.888571:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00002000:00100000:1.0:1787118787.888578:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff96136e5b0e00 x1873929544219904/t4294967314(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:578/0 lens 504/448 e 0 to 0 dl 1787118798 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787118787.888587:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e5b0e00 with x1873929544219904 ext(0->8) 00002000:00010000:1.0:1787118787.888591:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e5b0e00 00000100:00100000:3.0:1787118787.890917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118787.891578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220032 00000100:00100000:1.0:1787118787.891588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220032 00000100:00100000:1.0:1787118787.891651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 183 00000100:00100000:1.0:1787118787.891661:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+34:11552:x1873929544220032:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787118787.924874:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+34:11552:x1873929544220032:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 Request processed in 33205us (33957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118787.924887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 183 00000001:00080000:1.0:1787118787.924930:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:1.0:1787118787.924955:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787118787.924960:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1787118787.924972:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1787118787.925064:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787118787.927364:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787118787.927378:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787118787.927673:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.927706:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220160 00000100:00100000:3.0:1787118787.927713:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220160 00000100:00100000:3.0:1787118787.927776:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 54 00000100:00100000:3.0:1787118787.927786:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:2369:x1873929544220160:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787118787.927884:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566239360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787118787.927946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118787.928266:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566239360 00000100:00100000:3.0:1787118787.928271:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566239360 00000100:00100000:3.0:1787118787.928297:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787118787.928303:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566239360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787118787.928533:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787118787.928537:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787118787 00002000:00010000:3.0:1787118787.928539:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787118787.928541:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787118786 -> 1787118787 00002000:00010000:3.0:1787118787.928543:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787118787.928583:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566239360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (636us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787118787.928591:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1787118787.928811:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961375eba680/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787118787.928818:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566239360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787118787.960456:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:2369:x1873929544220160:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 Request processed in 32662us (32778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118787.960469:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 54 00000001:00080000:1.0:1787118787.960668:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1787118787.965047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.965130:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220416 00000100:00100000:3.0:1787118787.965139:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220416 00000100:00100000:3.0:1787118787.965290:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 184 00000100:00100000:3.0:1787118787.965310:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+18:11552:x1873929544220416:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.965363:0:7892:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118787.965401:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f919e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbdb expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.965420:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:3.0:1787118787.965424:0:7892:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787118787.965463:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.965475:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.965483:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787118787.965711:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b5613c6 reply state 000000008187da66 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.965754:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787118787.965845:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:11552:x1873929544220416:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 545us (876us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787118787.965851:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 184 00000100:00100000:0.0:1787118787.970426:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:2.0:1787118787.970532:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970546:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970554:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970561:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118787.970579:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970587:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970605:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:2.0:1787118787.970607:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118787.970612:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.970618:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f91b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.970683:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220544 00000100:00100000:3.0:1787118787.970692:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220544 00000100:00100000:3.0:1787118787.970861:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:3.0:1787118787.970871:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544220544:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787118787.971077:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787118787.971080:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787118787 -> 1787118785 00002000:00010000:3.0:1787118787.971083:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787118783 00002000:00010000:3.0:1787118787.971085:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787118787 -> 1787118785 00002000:00010000:3.0:1787118787.971088:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787118787.971147:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544220544:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 277us (733us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787118787.971155:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:1.0:1787118787.977142:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.977284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220800 00000100:00100000:3.0:1787118787.977307:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220800 00000100:00100000:3.0:1787118787.977360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 185 00000100:00100000:3.0:1787118787.977370:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+18:11552:x1873929544220800:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.977450:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.977468:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.977477:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.977511:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.977524:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 18 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.977537:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566239488:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118787.977631:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134bf02600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118787.981121:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118787.981325:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544220928 00000100:00100000:2.0:1787118787.981334:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544220928 00010000:00010000:2.0:1787118787.981370:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118787.981420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:2.0:1787118787.981430:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:2368:x1873929544220928:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118787.981443:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118787.981450:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.981464:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.981486:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:2.0:1787118787.981492:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.981509:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.981515:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.981534:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118787.981585:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:2368:x1873929544220928:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 156us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118787.981592:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 70 00010000:00010000:3.0:1787118787.982448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f9182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbcd expref: 18 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.982470:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566239488:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118787.982492:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982571:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982579:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982608:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982615:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982621:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982627:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118787.982631:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982638:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982659:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:2.0:1787118787.982662:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787118787.982666:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.982671:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f91ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118787.982804:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+17:11552:x1873929544220800:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 Request processed in 5435us (5671us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787118787.982813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 185 00000100:00100000:1.0:1787118787.989828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.990098:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221056 00000100:00100000:3.0:1787118787.990122:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221056 00000100:00100000:3.0:1787118787.990289:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:3.0:1787118787.990301:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544221056:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787118787.990346:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.990367:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.990375:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118787.990380:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118787.990394:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.990429:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.990444:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 8 pid: 6703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.990458:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566239616:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118787.990546:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134bf02600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118787.994043:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566239616:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118787.994072:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118787.995170:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118787.995463:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221184 00000100:00100000:3.0:1787118787.995471:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221184 00010000:00010000:3.0:1787118787.995505:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118787.995551:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:3.0:1787118787.995561:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544221184:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118787.995576:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118787.995598:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.995611:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.995634:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c80acf8/0xaa534e3c784f91ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbe9 expref: 9 pid: 6703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.995650:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118787.995654:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118787.995659:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.995670:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118787.995760:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118787.995807:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544221184:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 248us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118787.995815:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 71 00010000:00010000:2.0:1787118787.995938:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.995948:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.995973:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.995981:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.995988:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.995995:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118787.996006:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.996015:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.996027:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118787.996034:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4f479f/0xaa534e3c784f91c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118787.996079:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544221056:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 Request processed in 5781us (9359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118787.996086:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:2.0:1787118787.999354:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118787.999537:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221440 00000100:00100000:0.0:1787118787.999546:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221440 00000100:00100000:0.0:1787118787.999601:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 186 00000100:00100000:0.0:1787118787.999611:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+17:11552:x1873929544221440:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787118787.999689:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.999707:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.999718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.999961:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.999973:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118787.999982:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118788.000015:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118788.000029:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 18 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118788.000057:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566239744:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118788.000142:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118788.004684:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566239744:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118788.004712:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118788.010593:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118788.011210:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221568 00000100:00100000:1.0:1787118788.011220:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221568 00010000:00010000:1.0:1787118788.011274:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 19 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118788.011332:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:1.0:1787118788.011342:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:2369:x1873929544221568:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118788.011356:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118788.011363:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 19 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.011377:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 19 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787118788.011519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787118788.011602:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f9190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbd4 expref: 19 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.011618:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:1.0:1787118788.011624:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.011632:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.011638:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.011670:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118788.011759:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+18:2369:x1873929544221568:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 418us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118788.011768:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 72 00010000:00010000:2.0:1787118788.011838:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.011846:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118788.012044:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787118788.012204:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787118788.012250:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787118788.012552:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1873929566239872:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787118788.012616:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118788.012656:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff961348e656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118788.013993:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566239872 00000100:00100000:1.0:1787118788.014013:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566239872 00000100:00100000:1.0:1787118788.014073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118788.014083:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1873929566239872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787118788.014174:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1873929566239872:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118788.014182:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787118788.014545:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118788.014584:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1873929566239872:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787118788.015108:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787118788.015182:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1873929566240000:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787118788.015880:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118788.015932:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613432e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118788.016045:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566240000 00000100:00100000:1.0:1787118788.016051:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566240000 00000100:00100000:1.0:1787118788.016087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118788.016095:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1873929566240000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787118788.016504:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1873929566240000:12345-0@lo:1000:mdt00_000.0 Request processed in 408us (624us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787118788.016511:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118788.016550:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1873929566240000:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787118788.016586:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016596:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016604:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016610:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118788.016614:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016621:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016661:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8d00) 00010000:00010000:1.0:1787118788.016664:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118788.016669:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f91cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016700:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016706:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016711:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016716:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118788.016740:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016747:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016753:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:1.0:1787118788.016755:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118788.016758:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016764:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f910b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016794:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016807:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016816:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016842:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.016855:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118788.016867:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566240128:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118788.016940:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f6cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118788.022355:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118788.022773:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221696 00000100:00100000:3.0:1787118788.022782:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221696 00010000:00010000:3.0:1787118788.022818:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 22 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118788.022862:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 73 00000100:00100000:3.0:1787118788.022873:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+22:2369:x1873929544221696:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118788.022887:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118788.022895:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 22 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.022910:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 22 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.022946:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:3.0:1787118788.022952:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.022962:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.022970:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.023014:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118788.023062:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+22:2369:x1873929544221696:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 190us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118788.023070:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 73 00010000:00010000:1.0:1787118788.024966:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbb8 expref: 21 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118788.025067:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566240128:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118788.025094:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025105:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025111:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025139:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025145:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025152:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025159:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118788.025163:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025170:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025184:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:1.0:1787118788.025247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118788.025253:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025259:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f91d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025270:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025276:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025281:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025292:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118788.025295:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025365:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704c00) 00010000:00010000:1.0:1787118788.025377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787118788.025380:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118788.025453:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f91c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118788.025775:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+20:11552:x1873929544221440:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 26163us (26428us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787118788.025785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 186 00000020:00080000:1.0:1787118788.025790:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787118788.029510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118788.029835:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544221952 00000100:00100000:3.0:1787118788.029845:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544221952 00000100:00100000:3.0:1787118788.029894:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:3.0:1787118788.029904:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+20:11552:x1873929544221952:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787118788.030624:0:12487:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787118788.030776:0:12487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787118788.030824:0:12487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030839:0:12487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030850:0:12487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030859:0:12487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030865:0:12487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030871:0:12487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118788.030889:0:12487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118788.031031:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118788.031037:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.031044:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118788.031048:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.031055:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.031067:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff961359bc8000) 00010000:00010000:2.0:1787118788.031070:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787118788.031075:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.031080:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118788.031095:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118788.031102:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118788.031104:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118788.031818:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118788.031825:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118788.033274:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787118788.033290:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787118788.033750:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+22:11552:x1873929544221952:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 3840us (4242us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787118788.033763:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 50 00000020:00080000:3.0:1787118788.033770:0:12487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787118788.365080:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787118788.464770:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1787118788.464790:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1787118789.386979:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787118789.656611:0:12580:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787118789.656621:0:12580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118789.656689:0:12580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787118789.656697:0:12580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787118789.845387:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118789.845452:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544222208 00000100:00100000:3.0:1787118789.845461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544222208 00000100:00100000:3.0:1787118789.845519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 187 00000100:00100000:3.0:1787118789.845528:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+22:11570:x1873929544222208:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118789.845551:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118789.845570:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f91e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbf0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.845941:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f91eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.845956:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f91eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.845969:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f91eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118789.845980:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787118789.846152:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f91e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf0 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.846169:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f91eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf0 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.846185:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:3.0:1787118789.846187:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787118789.846191:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042400, rc 0) 00000100:00100000:3.0:1787118789.846253:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11570:x1873929544222208:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 725us (872us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787118789.846260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 187 00000100:00100000:0.0:1787118789.855315:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118789.855388:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544222336 00000100:00100000:3.0:1787118789.855397:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544222336 00000100:00100000:3.0:1787118789.855456:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 188 00000100:00100000:3.0:1787118789.855467:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+24:11570:x1873929544222336:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:3.0:1787118789.855538:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855554:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855565:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855579:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855586:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855593:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855917:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855926:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855934:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787118789.855970:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855982:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855988:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.855994:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856001:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.856004:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856012:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856023:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:3.0:1787118789.856027:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118789.856031:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856044:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f91f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856055:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856061:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856067:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856072:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.856076:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856081:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856090:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961359bc8400) 00010000:00010000:3.0:1787118789.856093:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118789.856096:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856102:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f9200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856115:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856121:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856133:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856138:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.856141:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856147:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856156:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8c00) 00010000:00010000:3.0:1787118789.856158:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118789.856161:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.856167:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118789.856253:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+24:11570:x1873929544222336:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 787us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118789.856261:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 188 00000100:00100000:0.0:1787118789.926067:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118789.926213:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544222592 00000100:00100000:3.0:1787118789.926222:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544222592 00000100:00100000:3.0:1787118789.926691:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 189 00000100:00100000:3.0:1787118789.926704:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11573:x1873929544222592:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118789.926741:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118789.926761:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f920e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbf7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926850:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926864:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926875:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926889:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926896:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.926915:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927246:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118789.927264:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787118789.927525:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927534:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927547:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927554:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.927559:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927567:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927578:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:3.0:1787118789.927582:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118789.927587:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927594:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f9215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927608:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927615:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927622:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927627:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.927630:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927646:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927655:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961359bc8c00) 00010000:00010000:3.0:1787118789.927657:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118789.927660:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927666:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042600/0xaa534e3c784f921c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927707:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f920e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927745:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.927754:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:3.0:1787118789.927756:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787118789.927758:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042c00, rc 0) 00000100:00100000:3.0:1787118789.927824:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+26:11573:x1873929544222592:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1122us (1767us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787118789.927833:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 189 00000100:00100000:3.0:1787118789.933234:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118789.933264:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544222720 00000100:00100000:3.0:1787118789.933272:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544222720 00000100:00100000:3.0:1787118789.933522:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 190 00000100:00100000:3.0:1787118789.933533:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+26:11573:x1873929544222720:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:3.0:1787118789.933603:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933620:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933630:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933654:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933661:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933667:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933672:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118789.933677:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933683:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933694:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:3.0:1787118789.933696:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118789.933701:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118789.933708:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f9231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118789.934102:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+26:11573:x1873929544222720:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 570us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118789.934309:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 190 00000100:00100000:2.0:1787118789.944157:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118789.947265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544222976 00000100:00100000:1.0:1787118789.947279:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544222976 00000100:00100000:1.0:1787118789.947336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:1.0:1787118789.947347:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+26:11573:x1873929544222976:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118789.947577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+27:11573:x1873929544222976:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 231us (3429us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787118789.947585:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:3.0:1787118789.999595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118789.999790:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544223232 00000100:00100000:0.0:1787118789.999800:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544223232 00000100:00100000:0.0:1787118789.999861:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 191 00000100:00100000:0.0:1787118789.999871:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:11098:x1873929544223232:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118789.999896:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118789.999927:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f9238 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bbfe expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.000025:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.000056:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.000065:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.000098:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.000112:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 28 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118790.000126:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566240256:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118790.000221:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787118790.007195:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1873929566240256:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118790.007228:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118790.007986:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.009861:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544223360 00000100:00100000:1.0:1787118790.009872:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544223360 00010000:00010000:1.0:1787118790.009968:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 29 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.010001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00100000:1.0:1787118790.010011:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:2368:x1873929544223360:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118790.010028:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118790.010035:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 29 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010048:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 29 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010070:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042c00/0xaa534e3c784f9223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf7 expref: 29 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010087:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:1.0:1787118790.010092:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010102:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010109:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.010146:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118790.010200:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+28:2368:x1873929544223360:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 190us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.010208:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00080000:2.0:1787118790.010283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118790.011063:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.011074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118790.011094:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787118790.011237:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81600/0xaa534e3c784f9238 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.011254:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.011262:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:3.0:1787118790.011264:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787118790.011267:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81200, rc 0) 00000100:00100000:3.0:1787118790.011311:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+28:11098:x1873929544223232:12345-192.168.203.10@tcp:101:bash.0 Request processed in 11442us (11727us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787118790.011319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 191 00000100:00100000:0.0:1787118790.016218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118790.016311:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544223616 00000100:00100000:2.0:1787118790.016320:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544223616 00000100:00100000:2.0:1787118790.016377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 192 00000100:00100000:2.0:1787118790.016387:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+28:11098:x1873929544223616:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:2.0:1787118790.016641:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.016657:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.016668:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118790.016883:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787118790.016928:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092dc7746 reply state 00000000324a1313 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118790.016937:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787118790.016985:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787118790.017089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11098:x1873929544223616:12345-192.168.203.10@tcp:36:bash.0 Request processed in 702us (879us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787118790.017097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 192 00000020:00080000:2.0:1787118790.017102:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787118790.020683:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020700:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020754:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020760:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118790.020766:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020773:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020788:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:3.0:1787118790.020792:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118790.020796:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.020802:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f924d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118790.025522:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.032917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544223744 00000100:00100000:3.0:1787118790.032931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544223744 00000100:00100000:2.0:1787118790.034627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 193 00000100:00100000:2.0:1787118790.034641:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+31:11098:x1873929544223744:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118790.034683:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118790.034705:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.034794:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc05 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.034809:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc05 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.034828:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:2.0:1787118790.034831:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118790.034835:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987a00, rc 0) 00000100:00100000:2.0:1787118790.034899:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:11098:x1873929544223744:12345-192.168.203.10@tcp:101:bash.0 Request processed in 261us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118790.034917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 193 00000100:00100000:1.0:1787118790.043914:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118790.044007:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544223872 00000100:00100000:0.0:1787118790.044016:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544223872 00000100:00100000:0.0:1787118790.044086:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 58 00000100:00100000:0.0:1787118790.044097:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613508f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:11098:x1873929544223872:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118790.044114:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118790.044134:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc0c expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118790.044170:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8544c1, atime: 0x6a8544bf, ctime: 0x6a8544c1, blocks: 0xb 00010000:00010000:0.0:1787118790.044193:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1787118790.044198:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118790.044207:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.044224:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.044236:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80000, rc 0) 00000100:00100000:0.0:1787118790.044300:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613508f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:11098:x1873929544223872:12345-192.168.203.10@tcp:101:bash.0 Request processed in 205us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118790.044308:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 58 00000100:00080000:2.0:1787118790.044941:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118790.048653:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.048751:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224000 00000100:00100000:1.0:1787118790.048759:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224000 00002000:00010000:1.0:1787118790.048797:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787118790.048802:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f73ea00 with x1873929544224000 ext(0->18446744073709551615) 00002000:00010000:1.0:1787118790.048814:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137f73ea00. 00000100:00100000:1.0:1787118790.048848:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:1.0:1787118790.048858:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544224000:12345-192.168.203.10@tcp:10:bash.0 00002000:00010000:1.0:1787118790.049136:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787118790.049140:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787118785 -> 1787118789 00002000:00010000:1.0:1787118790.049142:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787118783 -> 1787118783 00002000:00010000:1.0:1787118790.049144:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787118785 -> 1787118789 00002000:00010000:1.0:1787118790.049147:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787118790.049213:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544224000:12345-192.168.203.10@tcp:10:bash.0 Request processed in 356us (567us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787118790.049222:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00002000:00010000:1.0:1787118790.049226:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787118790.049228:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96137f73ea00 with x1873929544224000 ext(0->18446744073709551615) 00002000:00010000:1.0:1787118790.049233:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96137f73ea00. 00000040:00080000:0.0:1787118790.090619:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118790.090629:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118790.090660:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787118790.090666:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118790.179713:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118790.179836:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224128 00000100:00100000:2.0:1787118790.179845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224128 00000100:00100000:2.0:1787118790.179910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 194 00000100:00100000:2.0:1787118790.179921:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11587:x1873929544224128:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:2.0:1787118790.179990:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180006:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180034:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180049:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180055:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180061:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180348:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180358:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180364:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118790.180579:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180591:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180596:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180602:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180618:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.180622:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180629:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180641:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118790.180644:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.180648:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180656:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180669:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180675:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180681:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180685:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.180688:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180693:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180711:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96134bc94400) 00010000:00010000:2.0:1787118790.180714:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.180717:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180771:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986e00/0xaa534e3c784f9269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180786:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180791:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180796:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180801:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.180804:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180809:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180815:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:2.0:1787118790.180817:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.180820:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.180825:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118790.181104:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11587:x1873929544224128:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 1182us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118790.181114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 194 00000100:00100000:2.0:1787118790.276815:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.276913:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224384 00000100:00100000:1.0:1787118790.276923:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224384 00000100:00100000:1.0:1787118790.276988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 195 00000100:00100000:1.0:1787118790.276997:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+32:11590:x1873929544224384:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118790.277018:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118790.277037:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc13 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277125:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277138:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277149:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277161:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277167:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277184:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277500:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f928c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277509:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f928c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277516:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f928c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118790.277537:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787118790.277627:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277634:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277646:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277652:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118790.277656:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277664:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277676:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118790.277678:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118790.277682:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277687:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f927e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277699:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277706:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277712:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277718:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118790.277779:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277795:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277804:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96136106b600) 00010000:00010000:1.0:1787118790.277807:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118790.277810:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277816:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9285 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277854:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc13 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277866:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f928c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc13 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.277874:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:1.0:1787118790.277876:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787118790.277878:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9c00, rc 0) 00000100:00100000:1.0:1787118790.277956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+34:11590:x1873929544224384:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 960us (1149us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787118790.277966:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 195 00000100:00100000:3.0:1787118790.284264:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118790.284384:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224512 00000100:00100000:0.0:1787118790.284393:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224512 00000100:00100000:0.0:1787118790.284449:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 196 00000100:00100000:0.0:1787118790.284459:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+34:11590:x1873929544224512:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118790.284523:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.284541:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.284562:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.284596:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.284610:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 34 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118790.284625:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566240384:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118790.284754:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787118790.290468:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118790.290674:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224768 00000100:00100000:2.0:1787118790.290682:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224768 00000100:00100000:2.0:1787118790.290775:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:2.0:1787118790.290786:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+35:9983:x1873929544224768:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787118790.291118:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+36:9983:x1873929544224768:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 333us (657us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787118790.291127:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:0.0:1787118790.291406:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566240384:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118790.291430:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.300291:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.300497:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544224896 00000100:00100000:3.0:1787118790.300506:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544224896 00010000:00010000:3.0:1787118790.300544:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 36 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118790.300586:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 75 00000100:00100000:3.0:1787118790.300596:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350047850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+36:2368:x1873929544224896:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118790.300626:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118790.300634:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 36 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300648:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 36 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300670:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f923f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbfe expref: 36 pid: 5843 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300687:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:3.0:1787118790.300692:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300701:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300709:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.300787:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118790.300836:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350047850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+35:2368:x1873929544224896:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 241us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118790.300845:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 75 00010000:00010000:1.0:1787118790.301104:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301112:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301148:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301156:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301162:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301168:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118790.301184:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301192:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301201:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:1.0:1787118790.301204:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118790.301206:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.301212:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f929a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.301251:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+34:11590:x1873929544224512:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 16794us (16996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.301260:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 196 00000100:00100000:2.0:1787118790.307927:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.308284:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225152 00000100:00100000:1.0:1787118790.308294:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225152 00000100:00100000:1.0:1787118790.308361:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:1.0:1787118790.308392:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+34:11590:x1873929544225152:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118790.308627:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+35:11590:x1873929544225152:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 237us (708us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787118790.308636:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:3.0:1787118790.361774:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.361816:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.361831:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.361871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.361949:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225536 00000100:00100000:1.0:1787118790.361958:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225536 00000100:00100000:2.0:1787118790.361972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225280 00000100:00100000:2.0:1787118790.361978:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225280 00000100:00100000:1.0:1787118790.362021:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225408 00000100:00100000:2.0:1787118790.362024:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 305 00000100:00100000:1.0:1787118790.362026:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225408 00000100:00100000:2.0:1787118790.362039:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544225280:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118790.362051:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:1.0:1787118790.362061:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544225536:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118790.362112:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2369:x1873929544225280:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118790.362119:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 305 00000100:00100000:0.0:1787118790.362140:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:0.0:1787118790.362152:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544225408:12345-192.168.203.10@tcp:400:kworker.0 00000100:00080000:3.0:1787118790.362223:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118790.367351:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2369:x1873929544225536:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 5279us (5521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.367367:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:1.0:1787118790.367420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225664 00000100:00100000:1.0:1787118790.367428:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225664 00000100:00100000:1.0:1787118790.368251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:1.0:1787118790.368262:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544225664:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118790.368335:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2369:x1873929544225664:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 75us (6463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.368342:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 167 00000100:00100000:0.0:1787118790.368502:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544225408:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 6351us (6667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118790.368509:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00080000:3.0:1787118790.376862:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118790.411397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118790.469989:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118790.470124:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544225920 00000100:00100000:2.0:1787118790.470133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544225920 00000100:00100000:2.0:1787118790.470245:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 197 00000100:00100000:2.0:1787118790.470256:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+35:11601:x1873929544225920:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:2.0:1787118790.470280:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118790.470312:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f92a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc1a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470389:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470403:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470414:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470439:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470446:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.470453:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472090:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f92b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472108:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f92b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472119:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f92b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118790.472131:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787118790.472231:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472253:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472260:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472267:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.472272:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472280:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472292:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118790.472295:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.472299:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472305:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f92a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472319:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472326:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472332:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472337:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.472344:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472351:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472359:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96134bc94400) 00010000:00010000:2.0:1787118790.472361:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.472364:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472370:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f92af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472414:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f92a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc1a expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472616:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f92b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc1a expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.472623:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:2.0:1787118790.472626:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118790.472628:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118790.472797:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+37:11601:x1873929544225920:12345-192.168.203.10@tcp:101:cat.0 Request processed in 2542us (2817us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787118790.472806:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 197 00000100:00100000:0.0:1787118790.495539:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.506339:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544226176 00000100:00100000:1.0:1787118790.506354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544226176 00000100:00100000:1.0:1787118790.506434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 54 00000100:00100000:1.0:1787118790.506446:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+37:11601:x1873929544226176:12345-192.168.203.10@tcp:35:cat.0 00000100:00100000:1.0:1787118790.506701:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+38:11601:x1873929544226176:12345-192.168.203.10@tcp:35:cat.0 Request processed in 257us (11170us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787118790.506741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 54 00000100:00100000:3.0:1787118790.568510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.568667:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544226432 00000100:00100000:1.0:1787118790.568677:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544226432 00000100:00100000:1.0:1787118790.568774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 198 00000100:00100000:1.0:1787118790.568785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+38:11602:x1873929544226432:12345-192.168.203.10@tcp:36:rm.0 00010000:00010000:1.0:1787118790.568839:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787118790.568864:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f92b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc1a expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.568886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f928c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc13 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.568899:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc05 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.568919:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961359bc8400) 00010000:00010000:1.0:1787118790.568930:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118790.568982:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.568997:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569021:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569061:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569361:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569370:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.569376:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787118790.570028:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787118790.570038:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369727315916ns, next at 370727313339ns, rc = 0 00010000:00010000:0.0:1787118790.570099:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570109:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570135:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570142:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570148:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570177:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118790.570199:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570205:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570211:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570216:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118790.570220:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570226:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570236:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704f00) 00010000:00010000:0.0:1787118790.570239:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787118790.570243:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570260:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f92d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570282:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570287:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570291:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118790.570294:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570300:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570307:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118790.570309:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118790.570312:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118790.570316:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f92c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118790.570326:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000145df169 reply state 0000000011367146 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118790.570334:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787118790.570424:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+37:11602:x1873929544226432:12345-192.168.203.10@tcp:36:rm.0 Request processed in 1638us (1920us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787118790.570432:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 198 00010000:00010000:3.0:1787118790.572085:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118790.572096:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.572106:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118790.572110:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.572118:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.572132:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff961351704f00) 00010000:00010000:3.0:1787118790.572135:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787118790.572138:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.572144:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f92d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.572163:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118790.572165:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118790.572168:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118790.572317:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572325:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572344:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572349:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118790.572352:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572359:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572379:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704a00) 00010000:00010000:2.0:1787118790.572382:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118790.572386:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.572391:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81a00/0xaa534e3c784f92cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118790.629532:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.632382:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544226688 00000100:00100000:1.0:1787118790.632396:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544226688 00000100:00100000:1.0:1787118790.632468:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 199 00000100:00100000:1.0:1787118790.632480:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+36:11608:x1873929544226688:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118790.632501:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118790.632523:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f92e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc21 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.632673:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.633041:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.633053:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.633069:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.633076:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.633083:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787118790.636322:0:7892:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787118790.640007:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640029:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640041:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640079:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640086:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640094:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640112:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118790.640117:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640125:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640140:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118790.640143:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118790.640149:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640155:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f92e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118790.640170:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000635f4401 reply state 00000000bbb32d96 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.640179:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787118790.640442:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9c00/0xaa534e3c784f92e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 39 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640459:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 38 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.640467:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:1.0:1787118790.640469:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118790.640472:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8000, rc 0) 00000100:00100000:1.0:1787118790.640543:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+39:11608:x1873929544226688:12345-192.168.203.10@tcp:101:bash.0 Request processed in 8066us (11021us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787118790.640559:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 199 00010000:00010000:3.0:1787118790.646080:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646097:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646105:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646133:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118790.646139:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646146:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646163:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96136106b600) 00010000:00010000:3.0:1787118790.646166:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118790.646169:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118790.646177:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f92ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118790.646194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.646277:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544226816 00000100:00100000:1.0:1787118790.646287:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544226816 00000100:00100000:1.0:1787118790.646338:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:1.0:1787118790.646349:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2368:x1873929544226816:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118790.646372:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118790.646389:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc28 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787118790.646413:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787118790.646433:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1787118790.646437:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118790.646447:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.646465:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 6 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.646476:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9600, rc 0) 00000100:00100000:1.0:1787118790.646536:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544226816:12345-192.168.203.10@tcp:101:bash.0 Request processed in 188us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.646543:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:1.0:1787118790.654487:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118790.655831:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544226944 00000100:00100000:2.0:1787118790.655842:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544226944 00000100:00100000:2.0:1787118790.655917:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:2.0:1787118790.655927:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+6:11608:x1873929544226944:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:2.0:1787118790.655945:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118790.655964:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc2f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.655994:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.656021:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118790.656025:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118790.656030:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.656066:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.656079:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118790.656093:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566240512:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118790.656207:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350fd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118790.661759:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1873929566240512:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118790.661796:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118790.661816:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118790.661930:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:11608:x1873929544226944:12345-192.168.203.10@tcp:101:bash.0 Request processed in 6004us (7451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118790.661940:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:2.0:1787118790.668706:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118790.669128:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544227072 00000100:00100000:1.0:1787118790.669138:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544227072 00010000:00010000:1.0:1787118790.669176:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.669234:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:1.0:1787118790.669244:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544227072:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118790.669259:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118790.669279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.669292:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.669313:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3ffe657/0xaa534e3c784f9303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc28 expref: 7 pid: 8419 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.669328:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118790.669333:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787118790.669340:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.669351:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118790.669398:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118790.669412:0:5828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566240640:192.168.203.10@tcp:105: 00000100:00100000:1.0:1787118790.669497:0:5828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613411cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118790.679225:0:5828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1873929566240640:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118790.679251:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118790.679305:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+6:2369:x1873929544227072:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 10063us (10608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118790.679316:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:2.0:1787118790.687140:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118790.687361:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544227328 00000100:00100000:3.0:1787118790.687369:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544227328 00000100:00100000:3.0:1787118790.687426:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:3.0:1787118790.687437:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+38:11608:x1873929544227328:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:3.0:1787118790.687814:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+39:11608:x1873929544227328:12345-192.168.203.10@tcp:35:bash.0 Request processed in 378us (681us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787118790.687821:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 55 00000100:00100000:2.0:1787118791.043500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.043664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544227456 00000100:00100000:0.0:1787118791.043675:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544227456 00000100:00100000:0.0:1787118791.043757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 200 00000100:00100000:0.0:1787118791.043768:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+39:11624:x1873929544227456:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118791.043793:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.043814:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc36 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.043877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.043891:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.043914:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118791.043983:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787118791.043987:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118791.044011:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.044037:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc36 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.044058:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc36 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.044076:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118791.044079:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118791.044083:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80400, rc 0) 00000100:00100000:0.0:1787118791.044152:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961351520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+40:11624:x1873929544227456:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 386us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.044159:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 200 00000100:00100000:0.0:1787118791.050826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118791.051565:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544227712 00000100:00100000:2.0:1787118791.051579:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544227712 00000100:00100000:2.0:1787118791.051647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 201 00000100:00100000:2.0:1787118791.051658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+40:11624:x1873929544227712:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118791.051680:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118791.051701:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f931f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc3d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.051832:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.051846:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.051856:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118791.051866:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787118791.052023:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986800/0xaa534e3c784f931f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc3d expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.052040:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc3d expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.052049:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:2.0:1787118791.052052:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118791.052055:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:2.0:1787118791.052123:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+42:11624:x1873929544227712:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 467us (1307us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787118791.052146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 201 00000100:00100000:1.0:1787118791.089281:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.089331:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.089473:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228096 00000100:00100000:0.0:1787118791.089482:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228096 00000100:00100000:0.0:1787118791.089542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 202 00000100:00100000:0.0:1787118791.089553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+42:11624:x1873929544228096:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118791.089579:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.089602:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc44 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.089699:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.089714:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.089763:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118791.089776:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787118791.089907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81400/0xaa534e3c784f9334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc44 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.089945:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc44 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.089954:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:0.0:1787118791.089958:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787118791.089961:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80c00, rc 0) 00000100:00100000:0.0:1787118791.090021:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+44:11624:x1873929544228096:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 469us (687us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787118791.090028:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 202 00000100:00100000:3.0:1787118791.090142:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544227840 00000100:00100000:3.0:1787118791.090147:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544227840 00000100:00100000:3.0:1787118791.090186:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118791.090193:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+44:2369:x1873929544227840:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118791.090203:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118791.090225:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc3d expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.090236:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:3.0:1787118791.090240:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118791.090260:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+43:2369:x1873929544227840:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 68us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118791.090267:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118791.101665:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.101770:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228224 00000100:00100000:1.0:1787118791.101780:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228224 00000100:00100000:1.0:1787118791.101835:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:1.0:1787118791.101846:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+6:2368:x1873929544228224:12345-192.168.203.10@tcp:1:lfs.0 00010000:00010000:1.0:1787118791.101892:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.101923:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.101932:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787118791.101936:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118791.101941:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.101992:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.102026:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 6 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118791.102042:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566240768:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118791.102134:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613411cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118791.105537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118791.105643:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8419:1873929566240768:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118791.105668:0:8419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118791.107319:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228352 00000100:00100000:2.0:1787118791.107328:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228352 00002000:00100000:2.0:1787118791.107384:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96136eb63b80 x1873929544228352/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:582/0 lens 504/0 e 0 to 0 dl 1787118802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787118791.107395:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136eb63b80 with x1873929544228352 ext(0->8) 00010000:00010000:2.0:1787118791.107404:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 7 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.107421:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 7 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787118791.107491:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96136eb63b80 00000100:00100000:2.0:1787118791.107588:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:2.0:1787118791.107609:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544228352:12345-192.168.203.10@tcp:4:lfs.0 00000100:00100000:2.0:1787118791.108222:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544228352:12345-192.168.203.10@tcp:4:lfs.0 Request processed in 613us (2692us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787118791.108229:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00002000:00100000:2.0:1787118791.108239:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff96136eb63b80 x1873929544228352/t4294967308(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:582/0 lens 504/448 e 0 to 0 dl 1787118802 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787118791.108246:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136eb63b80 with x1873929544228352 ext(0->8) 00010000:00010000:2.0:1787118791.108253:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.108277:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787118791.108284:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96136eb63b80 00000100:00100000:2.0:1787118791.113130:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.113239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228480 00000100:00100000:0.0:1787118791.113249:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228480 00010000:00010000:0.0:1787118791.113290:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118791.113333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:0.0:1787118791.113342:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544228480:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118791.113356:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787118791.113374:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787118791.113377:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787118789 00002000:00010000:0.0:1787118791.113379:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787118790 00002000:00010000:0.0:1787118791.113381:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787118789 00010000:00010000:0.0:1787118791.113387:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.113400:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.114840:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa531cc1/0xaa534e3c784f930a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc2f expref: 9 pid: 6703 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.114859:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118791.114863:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118791.114869:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.114879:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.114985:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118791.115055:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544228480:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 1712us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.115065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 77 00010000:00010000:3.0:1787118791.115957:0:8419:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.115971:0:8419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116005:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116014:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116022:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116043:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118791.116047:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116056:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116072:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.116080:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e5e8e2c/0xaa534e3c784f9349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118791.116154:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544228224:12345-192.168.203.10@tcp:1:lfs.0 Request processed in 14307us (14495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118791.116163:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:2.0:1787118791.125256:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.125353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228736 00000100:00100000:1.0:1787118791.125362:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228736 00000100:00100000:1.0:1787118791.125432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 56 00000100:00100000:1.0:1787118791.125442:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+43:11624:x1873929544228736:12345-192.168.203.10@tcp:35:lfs.0 00000004:00010000:1.0:1787118791.125515:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc44 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118791.126145:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787118791.126203:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787118791.129291:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787118791.129396:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.129417:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 47 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.130649:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.130702:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 47 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.130934:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 47 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118791.130951:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566240896:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118791.131119:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787118791.135707:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118791.136123:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228864 00000100:00100000:3.0:1787118791.136132:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228864 00010000:00010000:3.0:1787118791.136171:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 48 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118791.136213:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 78 00000100:00100000:3.0:1787118791.136223:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+48:2369:x1873929544228864:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118791.136238:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118791.136246:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 48 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.136273:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 48 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.136294:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:3.0:1787118791.136300:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.136309:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.136316:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.136335:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118791.136410:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+48:2369:x1873929544228864:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 188us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118791.136419:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 78 00010000:00010000:1.0:1787118791.137812:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f92f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc21 expref: 47 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118791.137836:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1873929566240896:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118791.137861:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.137871:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.137877:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118791.138091:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787118791.138288:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787118791.138466:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566241024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787118791.138544:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118791.138649:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613411ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118791.138698:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241024 00000100:00100000:0.0:1787118791.138705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241024 00000100:00100000:0.0:1787118791.138918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787118791.138922:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118791.138929:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566241024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787118791.139505:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566241024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 578us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.139514:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787118791.139596:0:5845:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787118791.139602:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787118791.139620:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96137aa65880, transno 4294967307 00000100:00100000:1.0:1787118791.139697:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566241024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787118791.140190:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787118791.140258:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566241152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787118791.140293:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118791.140336:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787118791.140629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241152 00000100:00100000:3.0:1787118791.140635:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241152 00000100:00100000:3.0:1787118791.140679:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787118791.140688:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1873929566241152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787118791.140883:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1873929566241152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (588us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787118791.140890:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787118791.142617:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1873929566241152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787118791.142706:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787118791.142800:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142824:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142832:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142839:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.142843:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142851:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142875:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:0.0:1787118791.142879:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787118791.142883:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.142889:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9350 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787118791.143115:0:5845:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787118791.143217:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787118791.143229:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370300506505ns, next at 371300504155ns, rc = 0 00000001:00080000:0.0:1787118791.143236:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787118791.143270:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff96136106b000) 00010000:00010000:0.0:1787118791.143274:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787118791.143281:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f933b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc44 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118791.145109:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+50:11624:x1873929544228736:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 19659us (19854us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787118791.145123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 56 00000020:00080000:0.0:1787118791.145130:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787118791.148627:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.148797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544228992 00000100:00100000:0.0:1787118791.148806:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544228992 00000100:00100000:0.0:1787118791.148906:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 203 00000100:00100000:0.0:1787118791.148918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+50:11624:x1873929544228992:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118791.148943:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.148978:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80800/0xaa534e3c784f9357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc4b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.149043:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80800/0xaa534e3c784f9357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc4b expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.149058:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80800/0xaa534e3c784f9357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc4b expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.149078:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.149081:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118791.149085:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80800, rc 0) 00000100:00100000:0.0:1787118791.149146:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+51:11624:x1873929544228992:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 230us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.149153:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 203 00000100:00100000:2.0:1787118791.154252:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.155495:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544229248 00000100:00100000:1.0:1787118791.155508:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544229248 00000100:00100000:1.0:1787118791.155576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:1.0:1787118791.155587:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+51:11624:x1873929544229248:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:1.0:1787118791.155938:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+52:11624:x1873929544229248:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 352us (1692us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787118791.155946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 57 00000100:00100000:2.0:1787118791.283697:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.283860:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544229376 00000100:00100000:0.0:1787118791.283870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544229376 00000100:00100000:0.0:1787118791.283949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 204 00000100:00100000:0.0:1787118791.283959:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:11634:x1873929544229376:12345-192.168.203.10@tcp:34:lfs.0 00010000:00010000:0.0:1787118791.284030:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284067:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284082:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284090:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284096:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284190:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284199:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284205:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787118791.284244:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284256:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284269:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284276:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284283:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.284287:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284293:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284305:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118791.284308:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118791.284312:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284318:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f935e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284331:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284336:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284342:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284347:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.284356:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284362:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284369:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704d00) 00010000:00010000:0.0:1787118791.284372:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118791.284374:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284380:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284392:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284398:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284404:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284409:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.284412:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284418:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284425:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.284427:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118791.284435:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.284441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f936c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118791.284542:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+52:11634:x1873929544229376:12345-192.168.203.10@tcp:34:lfs.0 Request processed in 584us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.284550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 204 00000100:00100000:2.0:1787118791.342713:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.342833:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544229632 00000100:00100000:1.0:1787118791.342842:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544229632 00000100:00100000:1.0:1787118791.342913:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 205 00000100:00100000:1.0:1787118791.342923:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+52:11637:x1873929544229632:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118791.342943:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118791.342964:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9373 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc52 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343245:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343264:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343276:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343306:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343313:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343321:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343589:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343599:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343607:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118791.343617:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787118791.343716:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343754:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343762:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343769:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118791.343774:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343794:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343806:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118791.343809:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118791.343814:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343820:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f937a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343833:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343839:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343844:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343849:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118791.343852:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343858:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343865:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96136106b500) 00010000:00010000:1.0:1787118791.343867:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118791.343870:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343884:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343935:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc52 expref: 55 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343949:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc52 expref: 54 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.343957:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.343959:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118791.343962:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8a00, rc 0) 00000100:00100000:1.0:1787118791.344026:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+54:11637:x1873929544229632:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1104us (1322us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787118791.345486:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 205 00000100:00100000:1.0:1787118791.352001:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.353364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544229760 00000100:00100000:0.0:1787118791.353378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544229760 00000100:00100000:0.0:1787118791.353434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 206 00000100:00100000:0.0:1787118791.353444:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:11637:x1873929544229760:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:0.0:1787118791.353515:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353530:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353540:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353565:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353571:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353577:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353583:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.353603:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353611:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353623:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.353626:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118791.353630:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.353636:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f9396 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118791.353715:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+54:11637:x1873929544229760:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 272us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.353739:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 206 00000100:00100000:2.0:1787118791.357519:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.357593:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544230016 00000100:00100000:0.0:1787118791.357603:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544230016 00000100:00100000:0.0:1787118791.357658:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 58 00000100:00100000:0.0:1787118791.357668:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+54:11637:x1873929544230016:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118791.357938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+55:11637:x1873929544230016:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 270us (426us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787118791.357945:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 58 00010000:00010000:0.0:1787118791.441247:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118791.473717:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.473855:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544230272 00000100:00100000:0.0:1787118791.473864:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544230272 00000100:00100000:0.0:1787118791.473934:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 207 00000100:00100000:0.0:1787118791.473944:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137aa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+55:11647:x1873929544230272:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118791.473992:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.473995:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787118791.474021:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc36 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.474041:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118791.474046:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118791.474058:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f939d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc59 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.474163:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.474175:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.474184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118791.474195:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787118791.475535:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f939d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc59 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.475562:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc59 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.475570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.475573:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118791.475576:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80e00, rc 0) 00000100:00100000:0.0:1787118791.475666:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137aa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+56:11647:x1873929544230272:12345-192.168.203.10@tcp:101:bash.0 Request processed in 1723us (1958us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787118791.475674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 207 00000100:00100000:2.0:1787118791.482079:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.482177:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544230528 00000100:00100000:0.0:1787118791.482186:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544230528 00000100:00100000:0.0:1787118791.482243:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 208 00000100:00100000:0.0:1787118791.482253:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+56:11647:x1873929544230528:12345-192.168.203.10@tcp:36:bash.0 00010000:00010000:0.0:1787118791.482323:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787118791.482349:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc59 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.482380:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc52 expref: 55 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.482390:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.482395:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118791.482588:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.482601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.482611:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787118791.482656:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787118791.482678:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abda12b9 reply state 00000000d3963787 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118791.482704:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787118791.482838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+57:11647:x1873929544230528:12345-192.168.203.10@tcp:36:bash.0 Request processed in 586us (768us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787118791.482845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 208 00000020:00080000:0.0:1787118791.482849:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787118791.485611:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485628:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485635:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485640:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118791.485645:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485666:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485682:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.485685:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118791.485689:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.485695:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81e00/0xaa534e3c784f93b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118791.489610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.489840:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544230656 00000100:00100000:1.0:1787118791.489850:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544230656 00000100:00100000:1.0:1787118791.489953:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 209 00000100:00100000:1.0:1787118791.489963:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+56:11647:x1873929544230656:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:1.0:1787118791.489987:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118791.490007:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f93b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc60 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490094:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490118:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490130:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118791.490158:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787118791.490163:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118791.490201:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490226:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f93b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 58 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490245:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 57 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.490253:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.490256:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118791.490259:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118791.490325:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+57:11647:x1873929544230656:12345-192.168.203.10@tcp:101:bash.0 Request processed in 363us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.490332:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 209 00000100:00100000:2.0:1787118791.494386:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118791.494463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544230912 00000100:00100000:3.0:1787118791.494481:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544230912 00000100:00100000:3.0:1787118791.494529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:3.0:1787118791.494538:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+57:11647:x1873929544230912:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:3.0:1787118791.494772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+58:11647:x1873929544230912:12345-192.168.203.10@tcp:35:bash.0 Request processed in 234us (394us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787118791.494780:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 59 00000100:00100000:0.0:1787118791.498992:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566241536:0@lo:400:kworker.0 00000100:00100000:0.0:1787118791.499054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118791.499218:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118791.499225:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566241664:0@lo:400:kworker.0 00000100:00100000:0.0:1787118791.499250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118791.499279:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241664 00000100:00100000:0.0:1787118791.499285:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241664 00000100:00100000:0.0:1787118791.499450:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787118791.499458:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566241664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118791.499502:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566241664:12345-0@lo:400:kworker.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.499509:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787118791.499542:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566241664:0@lo:400:kworker.0 00000100:00100000:0.0:1787118791.499565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241536 00000100:00100000:0.0:1787118791.499568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241536 00000100:00100000:0.0:1787118791.499590:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787118791.499596:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118791.499624:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566241536:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.499630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787118791.499662:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566241536:0@lo:400:kworker.0 00000100:00080000:3.0:1787118791.499741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787118791.499747:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118791.499813:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566241408:0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.499841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118791.499858:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787118791.499863:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566241280:0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.499885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118791.499924:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566241792:0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.499943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118791.499982:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241408 00000100:00100000:1.0:1787118791.499986:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241408 00000100:00100000:1.0:1787118791.500008:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241792 00000100:00100000:1.0:1787118791.500010:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241792 00000100:00100000:1.0:1787118791.500029:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787118791.500035:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566241408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.500079:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566241408:12345-0@lo:400:kworker.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.500085:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787118791.500121:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566241408:0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.500140:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787118791.500147:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566241792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118791.500179:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566241792:12345-0@lo:400:kworker.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.500185:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787118791.500204:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566241792:0@lo:400:kworker.0 00000100:00100000:3.0:1787118791.500690:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566241280 00000100:00100000:3.0:1787118791.500696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566241280 00000100:00100000:3.0:1787118791.500759:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787118791.500767:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566241280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118791.500810:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3301:x1873929566241280:12345-0@lo:400:kworker.0 Request processed in 45us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118791.500817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1787118791.500843:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118791.502660:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3301:1873929566241280:0@lo:400:kworker.0 00000100:00100000:3.0:1787118791.579670:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.579773:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231040 00000100:00100000:1.0:1787118791.579783:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231040 00000100:00100000:1.0:1787118791.579843:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 210 00000100:00100000:1.0:1787118791.579854:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+58:11653:x1873929544231040:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118791.579878:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118791.579906:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f93c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc67 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.579969:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.579982:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.579992:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118791.580065:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787118791.580069:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118791.580089:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.580124:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f93c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc67 expref: 60 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.580142:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc67 expref: 59 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.580151:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118791.580154:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787118791.580156:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8000, rc 0) 00000100:00100000:1.0:1787118791.580217:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544231040:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 365us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.580223:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 210 00000100:00100000:2.0:1787118791.586251:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.586340:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231168 00000100:00100000:0.0:1787118791.586348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231168 00000100:00100000:0.0:1787118791.586404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 211 00000100:00100000:0.0:1787118791.586414:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544231168:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118791.586432:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.586449:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc6e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586503:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586516:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586527:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586539:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586546:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586552:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586637:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586644:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118791.586693:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787118791.586697:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118791.586711:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586753:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586760:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586767:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586773:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.586777:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586783:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586793:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118791.586796:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118791.586799:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f93dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586826:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586832:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586838:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586843:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118791.586845:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586851:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586857:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff961351704d00) 00010000:00010000:0.0:1787118791.586859:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118791.586861:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586867:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f93e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586890:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f93d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586919:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.586934:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.586936:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118791.586938:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80a00, rc 0) 00000100:00100000:0.0:1787118791.586990:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+60:11653:x1873929544231168:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 578us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.586998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 211 00000100:00100000:2.0:1787118791.592664:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118791.592713:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118791.592807:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231424 00000100:00100000:3.0:1787118791.592816:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231424 00000100:00100000:3.0:1787118791.592868:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 212 00000100:00100000:3.0:1787118791.592878:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+60:11653:x1873929544231424:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118791.592909:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118791.592931:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f93f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc75 expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593042:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593073:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593080:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593086:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593130:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593142:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118791.593156:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566241920:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118791.593256:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.593266:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118791.593274:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566242048:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118791.593297:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff961354481240 going to sleep for 11 seconds 00000100:00100000:1.0:1787118791.593464:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231552 00000100:00100000:1.0:1787118791.593468:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231552 00010000:00010000:1.0:1787118791.593487:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 62 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118791.593516:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:1.0:1787118791.593523:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+62:2370:x1873929544231552:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118791.593531:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118791.593536:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 62 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.593557:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 62 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.593573:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.593577:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.593583:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.593588:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118791.593611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+62:2370:x1873929544231552:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 89us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.593618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:3.0:1787118791.597979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:1.0:1787118791.598150:0:7892:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.10@tcp) returned -22 from blocking AST (req@0000000025af28b9 x1873929566241920) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.598172:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80a00/0xaa534e3c784f93ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc6e expref: 61 pid: 5842 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118791.598188:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566241920:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118791.598202:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566242048:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118791.598225:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.598231:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.598257:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.598266:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118791.598398:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231680 00000100:00100000:2.0:1787118791.598406:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231680 00010000:00010000:2.0:1787118791.598436:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118791.598470:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 80 00000100:00100000:2.0:1787118791.598479:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+61:2369:x1873929544231680:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118791.598493:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118791.598506:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598516:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598534:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f93c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc60 expref: 61 pid: 7892 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598545:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118791.598548:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598555:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598563:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118791.598590:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118791.598635:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+60:2369:x1873929544231680:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 158us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118791.598643:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 80 00010000:00010000:3.0:1787118791.599264:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.599281:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118791.599299:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787118791.599450:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042e00/0xaa534e3c784f93f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 61 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.599467:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 60 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118791.599474:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:3.0:1787118791.599476:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787118791.599478:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042200, rc 0) 00000100:00100000:3.0:1787118791.599525:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+60:11653:x1873929544231424:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 6648us (6810us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787118791.599532:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 212 00000100:00100000:3.0:1787118791.605226:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118791.605314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544231936 00000100:00100000:1.0:1787118791.605324:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544231936 00000100:00100000:1.0:1787118791.605391:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:1.0:1787118791.605401:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350044c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+60:11653:x1873929544231936:12345-192.168.203.10@tcp:103:lfs.0 00010000:00010000:1.0:1787118791.605417:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118791.605443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80800/0xaa534e3c784f9357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc4b expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118791.605461:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118791.605466:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118791.605519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350044c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544231936:12345-192.168.203.10@tcp:103:lfs.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118791.605527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:2.0:1787118791.608668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.608759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232064 00000100:00100000:0.0:1787118791.608768:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232064 00000100:00100000:0.0:1787118791.608823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 213 00000100:00100000:0.0:1787118791.608832:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544232064:12345-192.168.203.10@tcp:58:lfs.0 00010000:00010000:0.0:1787118791.608944:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.608969:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.608980:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787118791.609175:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787118791.609256:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544232064:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 424us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.609266:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 213 00000100:00100000:2.0:1787118791.612921:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118791.613420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232192 00000100:00100000:0.0:1787118791.613429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232192 00000100:00100000:0.0:1787118791.613490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 214 00000100:00100000:0.0:1787118791.613499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+59:11653:x1873929544232192:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118791.613532:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118791.613553:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc7c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613605:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613614:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613632:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613644:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613656:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118791.613659:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118791.613663:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118791.613669:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80c00, rc 0) 00000100:00100000:0.0:1787118791.613756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+60:11653:x1873929544232192:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 226us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118791.613763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 214 00000100:00100000:1.0:1787118792.010328:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118792.010411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118792.010623:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566242176 00000100:00100000:3.0:1787118792.010631:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566242176 00000100:00100000:3.0:1787118792.010683:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787118792.010692:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118792.010713:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118792.010788:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.010796:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787118792.011113:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566242176:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787118792.138936:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118792.138946:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118792.138983:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787118792.138990:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787118792.139651:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136eb60700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566242304:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787118792.139813:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1787118792.158863:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.158987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232320 00000100:00100000:0.0:1787118792.159009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232320 00000100:00100000:0.0:1787118792.159080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 215 00000100:00100000:0.0:1787118792.159091:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544232320:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787118792.159130:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787118792.159261:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544232320:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 172us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.159269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 215 00000100:00080000:3.0:1787118792.159664:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118792.160189:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136eb60700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566242304:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787118792.168935:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.171717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232448 00000100:00100000:0.0:1787118792.171766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232448 00000100:00100000:0.0:1787118792.171836:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 216 00000100:00100000:0.0:1787118792.171848:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+60:11654:x1873929544232448:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.171933:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.171950:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.171963:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172031:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172039:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172046:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172068:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172091:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172097:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118792.172135:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787118792.172140:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118792.172152:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172162:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172168:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172175:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172182:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118792.172186:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172193:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172204:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:0.0:1787118792.172208:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118792.172212:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9414 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172243:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172249:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172255:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172260:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118792.172263:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172270:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172279:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff961351704d00) 00010000:00010000:0.0:1787118792.172282:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118792.172285:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172290:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f941b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172304:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172310:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172322:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172328:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118792.172331:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172337:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172345:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118792.172347:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118792.172349:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.172354:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.172504:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+60:11654:x1873929544232448:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 Request processed in 656us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.172513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 216 00000100:00100000:2.0:1787118792.183856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.183969:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232704 00000100:00100000:0.0:1787118792.183979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232704 00000100:00100000:0.0:1787118792.184036:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 217 00000100:00100000:0.0:1787118792.184054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+60:11654:x1873929544232704:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.184075:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118792.184093:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9429 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc83 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184245:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184256:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118792.184267:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787118792.184578:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184587:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184594:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184600:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118792.184604:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184612:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184625:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:0.0:1787118792.184628:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787118792.184633:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184653:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184696:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9429 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc83 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184706:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:0.0:1787118792.184709:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787118792.184712:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9429 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc83 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.184829:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81000, rc 0) 00000100:00100000:0.0:1787118792.184888:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544232704:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 843us (1041us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787118792.184904:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 217 00000100:00100000:2.0:1787118792.197073:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.197218:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544232832 00000100:00100000:3.0:1787118792.197227:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544232832 00000100:00100000:3.0:1787118792.197284:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 218 00000100:00100000:3.0:1787118792.197295:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544232832:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787118792.197338:0:7892:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787118792.209337:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544232832:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 12033us (12263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.209379:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 218 00000100:00100000:1.0:1787118792.218928:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.219125:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233088 00000100:00100000:0.0:1787118792.219138:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233088 00000100:00100000:0.0:1787118792.219205:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 219 00000100:00100000:0.0:1787118792.219215:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544233088:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.219235:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118792.219238:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787118792.219264:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8000/0xaa534e3c784f93ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc67 expref: 61 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.219282:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:0.0:1787118792.219286:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118792.219326:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f943e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc8a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787118792.219699:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787118792.219915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.219928:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.219938:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.219980:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f943e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc8a expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.219993:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc8a expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.220001:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:0.0:1787118792.220003:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118792.220006:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80400, rc 0) 00000100:00100000:0.0:1787118792.220059:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+62:11654:x1873929544233088:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 845us (1139us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787118792.220065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 219 00000100:00100000:0.0:1787118792.231046:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.231685:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233344 00000100:00100000:1.0:1787118792.231695:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233344 00000100:00100000:1.0:1787118792.231782:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 220 00000100:00100000:1.0:1787118792.231793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+62:11654:x1873929544233344:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787118792.231848:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118792.231886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc8a expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.231914:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:1.0:1787118792.231924:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118792.231952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.231965:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.231974:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232045:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232054:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232062:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232563:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232572:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232578:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232584:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.232587:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232595:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232614:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:1.0:1787118792.232617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118792.232621:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232627:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9453 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232639:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232644:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232650:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232667:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.232670:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232676:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232684:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbcdea246 (ffff96136106b500) 00010000:00010000:1.0:1787118792.232686:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118792.232688:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.232694:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f945a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbcdea246 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.232821:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544233344:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 1029us (1783us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118792.232829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 220 00000100:00100000:1.0:1787118792.239998:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.240080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233472 00000100:00100000:0.0:1787118792.240089:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233472 00000100:00100000:0.0:1787118792.240158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 221 00000100:00100000:0.0:1787118792.240169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+61:11654:x1873929544233472:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.240213:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118792.240235:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9461 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc91 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240269:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240282:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240293:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240511:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9461 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240529:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.240538:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:0.0:1787118792.240541:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787118792.240544:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80400, rc 0) 00000100:00100000:0.0:1787118792.240607:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+62:11654:x1873929544233472:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 439us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.240614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 221 00000100:00100000:2.0:1787118792.247708:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.248501:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233728 00000100:00100000:1.0:1787118792.248510:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233728 00000100:00100000:1.0:1787118792.248561:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 222 00000100:00100000:1.0:1787118792.248570:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+62:11654:x1873929544233728:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787118792.248646:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.248661:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.248689:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787118792.249124:0:7892:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787118792.249134:0:7892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371406411238ns, next at 372406409003ns, rc = 0 00000004:00010000:1.0:1787118792.249292:0:7892:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000477038c9 reply state 000000005aa70b8a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.249302:0:7892:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118792.249527:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+64:11654:x1873929544233728:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 957us (1826us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787118792.249535:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 222 00010000:00010000:3.0:1787118792.254332:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254351:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254368:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254375:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118792.254380:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254388:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254405:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:3.0:1787118792.254408:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787118792.254412:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.254418:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f946f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.255421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.255560:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233856 00000100:00100000:0.0:1787118792.255571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233856 00000100:00100000:0.0:1787118792.255619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 223 00000100:00100000:0.0:1787118792.255627:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+63:11654:x1873929544233856:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.255660:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118792.255678:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc98 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.255746:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.255758:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.255775:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:0.0:1787118792.255778:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787118792.255781:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81c00, rc 0) 00000100:00100000:0.0:1787118792.256159:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+64:11654:x1873929544233856:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 210us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.256168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 223 00000100:00100000:1.0:1787118792.263447:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.263822:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544233984 00000100:00100000:0.0:1787118792.263831:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544233984 00000100:00100000:0.0:1787118792.265329:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:0.0:1787118792.265342:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+9:2369:x1873929544233984:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787118792.265654:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+10:2369:x1873929544233984:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 314us (2215us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787118792.265662:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00080000:3.0:1787118792.266060:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787118792.273686:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.273802:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544234240 00000100:00100000:3.0:1787118792.273823:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544234240 00000100:00100000:3.0:1787118792.273902:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:3.0:1787118792.273912:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+64:11654:x1873929544234240:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787118792.274152:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+65:11654:x1873929544234240:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 241us (476us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787118792.274161:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 60 00000100:00100000:2.0:1787118792.278853:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.279011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544234496 00000100:00100000:0.0:1787118792.279020:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544234496 00000100:00100000:0.0:1787118792.279075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 224 00000100:00100000:0.0:1787118792.279086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+65:11654:x1873929544234496:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787118792.279204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613500ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+65:11654:x1873929544234496:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.279212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 224 00000100:00100000:0.0:1787118792.281946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118792.282033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544234624 00000100:00100000:2.0:1787118792.282040:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544234624 00000100:00100000:2.0:1787118792.282093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 225 00000100:00100000:2.0:1787118792.282103:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+65:11654:x1873929544234624:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118792.282121:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118792.282142:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f947d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bc9f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282226:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282242:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282253:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118792.282289:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118792.282308:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282334:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987600/0xaa534e3c784f947d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc9f expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282352:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc9f expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.282367:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:2.0:1787118792.282370:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118792.282373:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987400, rc 0) 00000100:00100000:2.0:1787118792.282430:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+66:11654:x1873929544234624:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.282437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 225 00000100:00100000:2.0:1787118792.287105:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.287203:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544234752 00000100:00100000:0.0:1787118792.287211:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544234752 00000100:00100000:0.0:1787118792.287263:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:0.0:1787118792.287272:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+10:2368:x1873929544234752:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.287288:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118792.287306:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bca6 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118792.287330:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8544c7, blocks: 0x1 00010000:00010000:0.0:1787118792.287350:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1787118792.287354:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118792.287363:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.287381:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.287394:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80800, rc 0) 00000100:00100000:0.0:1787118792.287457:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+11:2368:x1873929544234752:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 185us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.287463:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:1.0:1787118792.300523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.301011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235008 00000100:00100000:0.0:1787118792.301022:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235008 00000100:00100000:0.0:1787118792.301082:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 226 00000100:00100000:0.0:1787118792.301091:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+66:11654:x1873929544235008:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787118792.301211:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+66:11654:x1873929544235008:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 120us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.301218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 226 00000100:00100000:1.0:1787118792.306633:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.306766:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235136 00000100:00100000:3.0:1787118792.306776:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235136 00000100:00100000:3.0:1787118792.306822:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:3.0:1787118792.306832:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+11:11654:x1873929544235136:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118792.306850:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118792.306868:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcad expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.306912:0:8419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 12 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.306920:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118792.306924:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118792.306929:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 12 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.306961:0:8419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 12 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.306977:0:8419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 12 pid: 6704 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.307005:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8419:1873929566242432:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118792.307101:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118792.311212:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.311495:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235264 00000100:00100000:0.0:1787118792.311504:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235264 00010000:00010000:0.0:1787118792.311541:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 13 pid: 6704 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.311587:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:0.0:1787118792.311597:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+13:2368:x1873929544235264:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118792.311612:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118792.311633:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 13 pid: 6704 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.311647:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 13 pid: 6704 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.311671:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118792.311676:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118792.311685:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 13 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.311715:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 13 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.311792:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 13 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.311806:0:8463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1873929566242560:192.168.203.10@tcp:105: 00000100:00100000:0.0:1787118792.311880:0:8463:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8300 going to sleep for 11 seconds 00010000:00010000:3.0:1787118792.311982:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f948b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bca6 expref: 13 pid: 6704 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.311996:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8419:1873929566242432:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118792.312021:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 12 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.312031:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042e00, rc 0) 00000100:00100000:3.0:1787118792.312059:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+12:11654:x1873929544235136:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 5229us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.312067:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:0.0:1787118792.319333:0:8463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1873929566242560:192.168.203.10@tcp:105: 00010000:00010000:0.0:1787118792.319367:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118792.319426:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+11:2368:x1873929544235264:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 7830us (8223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.319437:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:2.0:1787118792.322232:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.322324:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235392 00000100:00100000:3.0:1787118792.322333:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235392 00002000:00100000:3.0:1787118792.322391:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96136ebc6680 x1873929544235392/t0(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:583/0 lens 504/0 e 0 to 0 dl 1787118803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118792.322403:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136ebc6680 with x1873929544235392 ext(0->12) 00002000:00010000:3.0:1787118792.322408:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136ebc6680 00000100:00100000:3.0:1787118792.322442:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:3.0:1787118792.322451:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+11:2369:x1873929544235392:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787118792.322925:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b9d85e8-2500-4b81-a525-0303ce911299+13:2369:x1873929544235392:12345-192.168.203.10@tcp:4:lhsmtool_posix.0 Request processed in 473us (701us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787118792.322938:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00002000:00100000:3.0:1787118792.322946:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96136ebc6680 x1873929544235392/t4294967320(0) o4->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:583/0 lens 504/448 e 0 to 0 dl 1787118803 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118792.322955:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136ebc6680 with x1873929544235392 ext(0->12) 00002000:00010000:3.0:1787118792.322959:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136ebc6680 00000100:00100000:2.0:1787118792.331468:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.331565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235520 00000100:00100000:0.0:1787118792.331576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235520 00000100:00100000:0.0:1787118792.331633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 227 00000100:00100000:0.0:1787118792.331644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+66:11654:x1873929544235520:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787118792.384799:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+66:11654:x1873929544235520:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 Request processed in 53148us (53331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.384811:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 227 00000001:00080000:1.0:1787118792.385230:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:1.0:1787118792.385263:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787118792.385284:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787118792.385514:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566242688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787118792.385561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787118792.385653:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787118792.385657:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:2.0:1787118792.385694:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566242688 00000100:00100000:2.0:1787118792.385702:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566242688 00000100:00100000:2.0:1787118792.385767:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787118792.385776:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1873929566242688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787118792.385799:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787118792.385830:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8544c5, atime: 0x6a8544c6, ctime: 0x6a8544c5, blocks: 0x1 00010000:00010000:2.0:1787118792.385838:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.385852:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1787118792.385857:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118792.385863:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.385904:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.385914:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.385920:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.385936:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787118792.386547:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566242688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 770us (983us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787118792.386554:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1787118792.386577:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118792.386582:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.386590:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118792.386593:0:8462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.386602:0:8462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.386619:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.386632:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b621038/0xaa534e3c784f9499 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.386651:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118792.386653:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118792.386655:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787118792.386682:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961375c4ea00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787118792.386687:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375c4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566242688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787118792.390674:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118792.390787:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787118792.390808:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566242944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787118792.390872:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118792.390936:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566242944 00000100:00100000:0.0:1787118792.390943:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566242944 00000100:00100000:0.0:1787118792.390983:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787118792.390991:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566242944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787118792.391149:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787118792.391152:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787118791 00002000:00010000:0.0:1787118792.391154:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787118792.391156:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787118791 -> 1787118791 00002000:00010000:0.0:1787118792.391158:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787118792.391192:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1873929566242944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (320us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787118792.391199:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1787118792.391246:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96137f73ca80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787118792.391252:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566242944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787118792.391655:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.392188:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235648 00000100:00100000:0.0:1787118792.392194:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235648 00000100:00100000:0.0:1787118792.392282:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:0.0:1787118792.392291:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+13:2369:x1873929544235648:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 00000020:00080000:1.0:1787118792.393929:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9613411cac00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787118792.393940:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961360157d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9613411ca480 00000020:00080000:1.0:1787118792.393944:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff961360157800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136e973000 00000020:00080000:1.0:1787118792.394007:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961348e65cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787118792.394011:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96137a689900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961348e656c0 00000020:00080000:1.0:1787118792.394049:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96137a689c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136e5ae800 00000001:00080000:1.0:1787118792.394065:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787118792.394128:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787118792.394335:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787118792.395982:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566242816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787118792.396053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118792.399388:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566242816 00000100:00100000:3.0:1787118792.399402:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566242816 00000100:00100000:3.0:1787118792.399462:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787118792.399473:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3298:x1873929566242816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787118792.399501:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787118792.399523:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.399544:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.399553:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787118792.399557:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118792.399561:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.399594:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.399615:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 13 pid: 6705 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.399632:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566243072:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118792.399713:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347c5dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787118792.412096:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.412341:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544235776 00000100:00100000:1.0:1787118792.412350:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544235776 00010000:00010000:1.0:1787118792.412395:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 14 pid: 6705 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.412440:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:1.0:1787118792.412450:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:2369:x1873929544235776:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118792.412464:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118792.412471:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 14 pid: 6705 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.412485:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 14 pid: 6705 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.412510:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118792.412515:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787118792.412520:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.412530:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.412567:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118792.412624:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b9d85e8-2500-4b81-a525-0303ce911299+14:2369:x1873929544235776:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 174us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118792.412632:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 82 00010000:00010000:3.0:1787118792.413291:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f925b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc0c expref: 13 pid: 6705 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.413309:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566243072:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118792.413330:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.413339:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.413346:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.413354:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.413361:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.413397:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118792.413484:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118792.413493:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.413502:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118792.413508:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.413519:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.413546:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.413554:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dcafa08/0xaa534e3c784f94a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.413572:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118792.413575:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118792.413577:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118792.414013:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3298:x1873929566242816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14542us (17959us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787118792.414023:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1787118792.414190:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96137f73dc00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787118792.414197:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566242816:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787118792.463181:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787118792.476155:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1787118792.476177:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1787118792.476190:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787118792.476330:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+7:2369:x1873929544235648:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 Request processed in 84035us (84672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.476341:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:0.0:1787118792.485155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.485342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236032 00000100:00100000:1.0:1787118792.485351:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236032 00000100:00100000:1.0:1787118792.485509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 228 00000100:00100000:1.0:1787118792.485520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+20:11654:x1873929544236032:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787118792.485569:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118792.485595:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9484 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc9f expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.485613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:1.0:1787118792.485617:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118792.485652:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.485665:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.485674:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118792.487766:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3e6c215 reply state 0000000027b6825a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.487782:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118792.488178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:11654:x1873929544236032:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 2656us (3028us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787118792.488187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 228 00010000:00010000:1.0:1787118792.489938:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.489953:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.489961:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.489968:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.489972:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.489980:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.489995:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:1.0:1787118792.489998:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118792.490002:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.490008:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f94a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.492664:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.493034:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236160 00000100:00100000:1.0:1787118792.493044:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236160 00000100:00100000:1.0:1787118792.493099:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:1.0:1787118792.493109:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544236160:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787118792.493340:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787118792.493344:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787118791 -> 1787118790 00002000:00010000:1.0:1787118792.493346:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787118790 00002000:00010000:1.0:1787118792.493348:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787118791 -> 1787118790 00002000:00010000:1.0:1787118792.493351:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787118792.493925:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544236160:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 804us (1257us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787118792.493935:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:3.0:1787118792.497220:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118792.497473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236416 00000100:00100000:2.0:1787118792.497482:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236416 00000100:00100000:2.0:1787118792.497589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 229 00000100:00100000:2.0:1787118792.497599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+20:11654:x1873929544236416:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787118792.497662:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.497690:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.497699:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.497791:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.497812:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 20 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.497827:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566243200:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118792.497937:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118792.501232:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1873929566243200:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118792.501273:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.503316:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.504684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236544 00000100:00100000:1.0:1787118792.504695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236544 00010000:00010000:2.0:1787118792.504829:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.505087:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 83 00000100:00100000:2.0:1787118792.505098:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+21:2368:x1873929544236544:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118792.505113:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118792.505120:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505133:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505155:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80400/0xaa534e3c784f9468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc91 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505171:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:2.0:1787118792.505189:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505198:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505206:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.505243:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118792.505320:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b9d85e8-2500-4b81-a525-0303ce911299+20:2368:x1873929544236544:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 223us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.505329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 83 00010000:00010000:3.0:1787118792.505404:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505413:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505441:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505447:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505453:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505459:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118792.505463:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505470:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505485:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:3.0:1787118792.505488:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787118792.505491:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.505497:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f94ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.505537:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+19:11654:x1873929544236416:12345-192.168.203.10@tcp:55:lhsmtool_posix.0 Request processed in 7940us (8325us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787118792.505545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 229 00000100:00100000:3.0:1787118792.509923:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118792.510082:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236672 00000100:00100000:0.0:1787118792.510092:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236672 00000100:00100000:0.0:1787118792.510146:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:0.0:1787118792.510155:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2371:x1873929544236672:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787118792.510197:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.510216:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.510238:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118792.510242:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118792.510258:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.510291:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 8 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.510316:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 8 pid: 8419 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.510330:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566243328:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118792.510421:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f7e8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118792.515801:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.516278:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544236800 00000100:00100000:3.0:1787118792.516287:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544236800 00010000:00010000:3.0:1787118792.516338:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 9 pid: 8419 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.516388:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 84 00000100:00100000:3.0:1787118792.516569:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2368:x1873929544236800:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118792.516584:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118792.516606:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 9 pid: 8419 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.516620:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 9 pid: 8419 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.516644:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118792.516661:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787118792.516667:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.516677:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.516710:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118792.516786:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+9:2368:x1873929544236800:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 220us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.516794:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 84 00010000:00010000:0.0:1787118792.516922:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f4d0b4/0xaa534e3c784f9492 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcad expref: 8 pid: 8419 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.516938:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebdad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1873929566243328:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118792.516956:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.516968:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.516974:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517007:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517016:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517023:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517030:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118792.517034:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517042:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517054:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.517062:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c238b34/0xaa534e3c784f94b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118792.517104:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544236672:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 Request processed in 6950us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118792.517111:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 70 00000100:00100000:2.0:1787118792.523050:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118792.523072:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566243456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118792.523137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118792.523188:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566243456 00000100:00100000:2.0:1787118792.523195:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566243456 00000100:00100000:2.0:1787118792.523242:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787118792.523264:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566243456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118792.523287:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787118792.523339:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873929566243456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.523346:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787118792.524357:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787118792.524366:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961375eba680, transno 4294967315 00000004:00080000:2.0:1787118792.524423:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787118792.524444:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96137f73ca80, transno 4294967321 00000100:00100000:3.0:1787118792.527282:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.527352:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237056 00000100:00100000:1.0:1787118792.527362:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237056 00000100:00100000:1.0:1787118792.527496:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 230 00000100:00100000:1.0:1787118792.527507:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:11654:x1873929544237056:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787118792.527586:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.527603:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.527615:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.527836:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.527859:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.528211:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.528310:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.528327:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 20 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.528342:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566243584:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118792.528628:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787118792.529104:0:3300:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96137f73dc00 x1873929566242816/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787118808 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118792.529133:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566243456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787118792.532128:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566243584:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118792.532155:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.540561:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118792.540668:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237184 00000100:00100000:2.0:1787118792.540677:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237184 00010000:00010000:2.0:1787118792.540715:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.540796:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:2.0:1787118792.540805:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+21:2368:x1873929544237184:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118792.540819:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118792.540826:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540850:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540872:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81c00/0xaa534e3c784f9476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc98 expref: 21 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540897:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:2.0:1787118792.540902:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540919:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540926:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.540978:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118792.541030:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b9d85e8-2500-4b81-a525-0303ce911299+20:2368:x1873929544237184:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 226us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.541037:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 85 00010000:00010000:1.0:1787118792.541344:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.541353:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118792.541543:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787118792.541691:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787118792.541768:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787118792.541859:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566243712:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787118792.542075:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118792.542107:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787118792.542138:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566243712 00000100:00100000:1.0:1787118792.542142:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566243712 00000100:00100000:1.0:1787118792.542176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118792.542183:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566243712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787118792.542246:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566243712:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118792.542253:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787118792.542294:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566243712:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787118792.542700:0:7892:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787118792.542774:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566243840:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787118792.542801:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118792.542823:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1787118792.542846:0:12488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566243840 00000100:00100000:0.0:1787118792.542851:0:12488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566243840 00000100:00100000:0.0:1787118792.542883:0:12488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787118792.542899:0:12488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7892:x1873929566243840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787118792.543052:0:12488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7892:x1873929566243840:12345-0@lo:1000:mdt00_003.0 Request processed in 162us (249us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787118792.543059:0:12488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787118792.545142:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7892:1873929566243840:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787118792.545185:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545196:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545202:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545208:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.545212:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545218:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545252:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff961351704d00) 00010000:00010000:1.0:1787118792.545255:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118792.545260:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545266:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545295:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545313:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545319:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545325:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.545328:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545334:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545342:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118792.545344:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787118792.545595:0:7892:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545610:0:7892:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545626:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.545659:0:7892:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.545672:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566243968:192.168.203.10@tcp:105: 00000100:00100000:1.0:1787118792.545833:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787118792.550815:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118792.550955:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237312 00000100:00100000:2.0:1787118792.550964:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237312 00000100:00100000:2.0:1787118792.551016:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:2.0:1787118792.551026:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11653:x1873929544237312:12345-192.168.203.10@tcp:49:lfs.0 00000100:00100000:1.0:1787118792.551780:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566243968:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118792.551809:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551820:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80e00/0xaa534e3c784f9406 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551863:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551878:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551896:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551904:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551910:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551930:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.551936:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.551939:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552107:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552121:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118792.552124:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118792.552128:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552134:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552145:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552152:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552158:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552163:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118792.552166:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552182:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552189:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118792.552191:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787118792.552194:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.552199:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.552834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11653:x1873929544237312:12345-192.168.203.10@tcp:49:lfs.0 Request processed in 1805us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.552856:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 61 00000100:00100000:3.0:1787118792.555695:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.555759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237568 00000100:00100000:3.0:1787118792.555768:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237568 00000100:00100000:3.0:1787118792.555817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 231 00000100:00100000:3.0:1787118792.555826:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11653:x1873929544237568:12345-192.168.203.10@tcp:58:lfs.0 00000040:00080000:3.0:1787118792.556212:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787118792.556286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+24:11653:x1873929544237568:12345-192.168.203.10@tcp:58:lfs.0 Request processed in 460us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.556294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 231 00000040:00080000:0.0:1787118792.556741:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118792.556746:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118792.556793:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787118792.556800:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787118792.559979:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566244096:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787118792.560072:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d880c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118792.562121:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+24:11654:x1873929544237056:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 34607us (34840us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787118792.562136:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 230 00000020:00080000:1.0:1787118792.562144:0:7892:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787118792.564663:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873929566244096:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787118792.567593:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.567671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237824 00000100:00100000:1.0:1787118792.567680:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237824 00000100:00100000:1.0:1787118792.567773:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 62 00000100:00100000:1.0:1787118792.567783:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+23:11654:x1873929544237824:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787118792.568705:0:5844:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787118792.569193:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787118792.569251:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569268:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569291:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569299:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569305:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569312:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.569335:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118792.569645:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118792.569653:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.569660:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118792.569663:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.569671:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.569684:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96136106b500) 00010000:00010000:0.0:1787118792.569688:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787118792.569692:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.569698:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f94d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118792.569715:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118792.569763:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118792.569765:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118792.570103:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:11654:x1873929544237824:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 2316us (2515us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787118792.570113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 62 00000020:00080000:1.0:1787118792.570119:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787118792.578017:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.578246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544237952 00000100:00100000:3.0:1787118792.578255:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544237952 00000100:00100000:3.0:1787118792.578319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 232 00000100:00100000:3.0:1787118792.578328:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+25:11655:x1873929544237952:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787118792.578387:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787118792.578494:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+25:11655:x1873929544237952:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 167us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.578501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 232 00000100:00100000:0.0:1787118792.583238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.583612:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544238208 00000100:00100000:3.0:1787118792.583622:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544238208 00000100:00100000:3.0:1787118792.583680:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 233 00000100:00100000:3.0:1787118792.583691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+25:11655:x1873929544238208:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787118792.583712:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118792.584033:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcb4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.584126:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f94df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.584139:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f94df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.584150:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f94df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118792.584160:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787118792.584279:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcb4 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.584296:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f94df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcb4 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.584322:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:3.0:1787118792.584325:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787118792.584329:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042800, rc 0) 00000100:00100000:3.0:1787118792.585990:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+27:11655:x1873929544238208:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 2292us (2752us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787118792.586002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 233 00000100:00100000:2.0:1787118792.595463:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.595600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544238464 00000100:00100000:3.0:1787118792.595609:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544238464 00000100:00100000:3.0:1787118792.595666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 234 00000100:00100000:3.0:1787118792.595674:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+27:11655:x1873929544238464:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787118792.595776:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.595792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.595803:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596004:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596012:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596019:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596050:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118792.596054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596061:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596072:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:3.0:1787118792.596075:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787118792.596079:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.596084:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042000/0xaa534e3c784f94ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.596285:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+28:11655:x1873929544238464:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 610us (831us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787118792.596292:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 234 00000040:00080000:1.0:1787118792.596621:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118792.596626:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118792.597142:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787118792.597152:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787118792.611064:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.612855:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544238720 00000100:00100000:3.0:1787118792.612868:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544238720 00000100:00100000:3.0:1787118792.612941:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:3.0:1787118792.612951:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+28:11655:x1873929544238720:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787118792.613199:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+29:11655:x1873929544238720:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 249us (2145us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787118792.613207:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 63 00000100:00100000:2.0:1787118792.632820:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118792.632903:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544238848 00000100:00100000:1.0:1787118792.632911:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544238848 00000100:00100000:1.0:1787118792.632972:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 235 00000100:00100000:1.0:1787118792.632982:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+29:11657:x1873929544238848:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118792.633004:0:7892:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118792.633026:0:7892:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcbb expref: -99 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633104:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633116:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633125:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633138:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633144:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633149:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633769:0:7892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633783:0:7892:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 30 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633791:0:7892:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633823:0:7892:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 30 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118792.633850:0:7892:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 30 pid: 7892 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118792.633865:0:7892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566244224:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118792.634009:0:7892:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118792.638908:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118792.639044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239104 00000100:00100000:2.0:1787118792.639053:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239104 00000100:00100000:2.0:1787118792.639105:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:2.0:1787118792.639114:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+31:9983:x1873929544239104:12345-192.168.203.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787118792.639335:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:9983:x1873929544239104:12345-192.168.203.10@tcp:35:ldlm_bl.0 Request processed in 220us (434us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787118792.639343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 64 00000100:00100000:1.0:1787118792.640049:0:7892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375bead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7892:1873929566244224:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118792.640074:0:7892:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118792.645468:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118792.645610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239232 00000100:00100000:3.0:1787118792.645619:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239232 00010000:00010000:3.0:1787118792.645669:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 32 pid: 7892 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118792.645711:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:3.0:1787118792.645754:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:2369:x1873929544239232:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787118792.645769:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787118792.645777:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 32 pid: 7892 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645791:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 32 pid: 7892 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042200/0xaa534e3c784f93f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc75 expref: 32 pid: 7892 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645828:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:3.0:1787118792.645832:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645842:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645849:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118792.645882:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118792.645933:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b9d85e8-2500-4b81-a525-0303ce911299+31:2369:x1873929544239232:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 213us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118792.645940:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 86 00010000:00010000:2.0:1787118792.646361:0:7892:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646370:0:7892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118792.646420:0:7892:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787118792.646425:0:7892:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118792.646443:0:7892:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646456:0:7892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646466:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646472:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646478:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646484:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118792.646488:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646494:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646503:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118792.646506:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118792.646518:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646524:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f94fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646537:0:7892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646543:0:7892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646548:0:7892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646553:0:7892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118792.646556:0:7892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646562:0:7892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646570:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff96136106b100) 00010000:00010000:2.0:1787118792.646572:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118792.646576:0:7892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646582:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9800/0xaa534e3c784f9502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646618:0:7892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f94f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcbb expref: 31 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646643:0:7892:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcbb expref: 30 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118792.646651:0:7892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118792.646653:0:7892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118792.646655:0:7892:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9a00, rc 0) 00000100:00100000:2.0:1787118792.646696:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+30:11657:x1873929544238848:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 13716us (13885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118792.646703:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 235 00000040:00080000:3.0:1787118793.339691:0:12632:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787118793.339702:0:12632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118793.339789:0:12632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787118793.339796:0:12632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787118793.482153:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118793.500612:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118793.500694:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239488 00000100:00100000:1.0:1787118793.500703:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239488 00000100:00100000:1.0:1787118793.500787:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 236 00000100:00100000:1.0:1787118793.500798:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+30:11680:x1873929544239488:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118793.500820:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118793.500840:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9510 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcc2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.500955:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9517 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.500970:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.500980:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118793.501006:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787118793.501129:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f9510 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc2 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.501147:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9517 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.501156:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118793.501158:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787118793.501162:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118793.501214:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+32:11680:x1873929544239488:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 418us (611us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787118793.501222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 236 00000100:00100000:3.0:1787118793.503276:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118793.504055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239616 00000100:00100000:1.0:1787118793.504064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239616 00000100:00100000:1.0:1787118793.504124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 237 00000100:00100000:1.0:1787118793.504135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11680:x1873929544239616:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:1.0:1787118793.504200:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504216:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504228:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504253:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504267:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504274:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504281:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118793.504285:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504293:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504306:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:1.0:1787118793.504309:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118793.504313:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118793.504320:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8a00/0xaa534e3c784f9525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118793.504403:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134649e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b9d85e8-2500-4b81-a525-0303ce911299+32:11680:x1873929544239616:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 269us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118793.504412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 237 00000100:00100000:1.0:1787118793.595010:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118793.595082:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239744 00000100:00100000:3.0:1787118793.595092:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239744 00000100:00100000:3.0:1787118793.595148:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 71 00000100:00100000:3.0:1787118793.595173:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2368:x1873929544239744:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:3.0:1787118793.595192:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118793.595214:0:8419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fafd4c4c/0xaa534e3c784f952c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcc9 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118793.595240:0:8419:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8544c6, atime: 0x6a8544c6, ctime: 0x6a8544c6, blocks: 0xb 00010000:00010000:3.0:1787118793.595258:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1787118793.595264:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118793.595273:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fafd4c4c/0xaa534e3c784f952c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc9 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118793.595289:0:8419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fafd4c4c/0xaa534e3c784f952c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc9 expref: 8 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118793.595325:0:8419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042200, rc 0) 00000100:00100000:3.0:1787118793.595380:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+8:2368:x1873929544239744:12345-192.168.203.10@tcp:101:cat.0 Request processed in 222us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118793.595386:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 71 00000001:00080000:0.0:1787118793.598287:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787118793.598300:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787118793.603849:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118793.604963:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544239872 00000100:00100000:3.0:1787118793.604977:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544239872 00002000:00100000:3.0:1787118793.605052:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff96136e2c6680 x1873929544239872/t0(0) o3->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:584/0 lens 488/0 e 0 to 0 dl 1787118804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118793.605064:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e2c6680 with x1873929544239872 ext(0->4095) 00002000:00010000:3.0:1787118793.605070:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e2c6680 00000100:00100000:3.0:1787118793.605102:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:3.0:1787118793.605111:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544239872:12345-192.168.203.10@tcp:3:cat.0 00000100:00100000:3.0:1787118793.605933:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b9d85e8-2500-4b81-a525-0303ce911299+8:2369:x1873929544239872:12345-192.168.203.10@tcp:3:cat.0 Request processed in 819us (2089us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787118793.605944:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00002000:00100000:3.0:1787118793.605953:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff96136e2c6680 x1873929544239872/t0(0) o3->4b9d85e8-2500-4b81-a525-0303ce911299@192.168.203.10@tcp:584/0 lens 488/4536 e 0 to 0 dl 1787118804 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787118793.605961:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96136e2c6680 with x1873929544239872 ext(0->4095) 00002000:00010000:3.0:1787118793.605966:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96136e2c6680 00010000:00010000:2.0:1787118794.506428:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118795.484292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118795.484412:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118795.484439:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118795.484473:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118795.484499:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118795.484530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240512 00000100:00100000:3.0:1787118795.484539:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240512 00000100:00100000:3.0:1787118795.484593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240128 00000100:00100000:3.0:1787118795.484597:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240128 00000100:00100000:3.0:1787118795.484620:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:3.0:1787118795.484628:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544240512:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118795.484711:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:2370:x1873929544240512:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118795.484718:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 171 00000100:00100000:3.0:1787118795.484766:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00100000:3.0:1787118795.484772:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:2370:x1873929544240128:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118795.484801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b9d85e8-2500-4b81-a525-0303ce911299+32:2370:x1873929544240128:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118795.484807:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 172 00000100:00080000:3.0:1787118795.484825:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118795.484956:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240256 00000100:00100000:3.0:1787118795.484961:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240256 00000100:00100000:3.0:1787118795.484988:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240384 00000100:00100000:3.0:1787118795.484990:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240384 00000100:00100000:3.0:1787118795.485009:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 103 00000100:00100000:3.0:1787118795.485016:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544240256:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118795.485802:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+8:2370:x1873929544240256:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 784us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118795.485809:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 103 00000100:00100000:3.0:1787118795.485827:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00100000:3.0:1787118795.485835:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2370:x1873929544240384:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118795.485858:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2370:x1873929544240384:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 25us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118795.485864:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00080000:3.0:1787118795.486513:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118795.486518:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118795.492191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240000 00000100:00100000:0.0:1787118795.492204:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240000 00000100:00100000:0.0:1787118795.492405:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 307 00000100:00100000:0.0:1787118795.492415:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544240000:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118795.492547:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544240000:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 133us (8264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118795.492555:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 307 00010000:00010000:2.0:1787118795.531012:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118796.566545:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118796.620574:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566244608:0@lo:400:kworker.0 00000100:00100000:3.0:1787118796.620638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118796.620695:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118796.620702:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566244736:0@lo:400:kworker.0 00000100:00100000:3.0:1787118796.620756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118796.620790:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244608 00000100:00100000:3.0:1787118796.620796:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244608 00000100:00100000:3.0:1787118796.620853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787118796.620872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566244608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118796.620917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566244608:12345-0@lo:400:kworker.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118796.620924:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787118796.620944:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244736 00000100:00100000:3.0:1787118796.620948:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244736 00000100:00100000:3.0:1787118796.620971:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787118796.620977:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566244736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118796.621007:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1873929566244736:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118796.621013:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787118796.621027:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787118796.621031:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118796.621063:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566244736:0@lo:400:kworker.0 00000100:00100000:3.0:1787118796.621073:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566244608:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621122:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566244480:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118796.621183:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566244992:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118796.621233:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787118796.621238:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566244352:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118796.621286:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566244864:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118796.621329:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244992 00000100:00100000:1.0:1787118796.621332:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244992 00000100:00100000:1.0:1787118796.621362:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787118796.621367:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566244992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621399:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566244992:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118796.621405:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787118796.621422:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244352 00000100:00100000:1.0:1787118796.621425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244352 00000100:00100000:1.0:1787118796.621448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787118796.621454:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566244352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621483:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350892050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566244352:12345-0@lo:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118796.621489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787118796.621513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244480 00000100:00100000:1.0:1787118796.621517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244480 00000100:00100000:1.0:1787118796.621536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566244864 00000100:00100000:1.0:1787118796.621538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566244864 00000100:00100000:1.0:1787118796.621556:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787118796.621562:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566244480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621591:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566244480:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118796.621603:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787118796.621614:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787118796.621619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566244864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566244864:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118796.621650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1787118796.621670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787118796.621674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787118796.621691:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566244352:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621700:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566244864:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621708:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566244480:0@lo:400:kworker.0 00000100:00100000:1.0:1787118796.621715:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787118796.621749:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787118796.621765:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961375c4ea00, transno 4294967310 00000100:00100000:1.0:1787118796.621776:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566244992:0@lo:400:kworker.0 00000100:00100000:1.0:1787118797.130231:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118797.130262:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118797.130323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118797.130507:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245120 00000100:00100000:2.0:1787118797.130515:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245120 00000100:00100000:2.0:1787118797.130571:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787118797.130579:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136eb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566245120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787118797.130611:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118797.130663:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136eb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566245120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118797.130670:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787118797.130766:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787118797.579976:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118797.642196:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118797.642258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118797.642337:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245248 00000100:00100000:2.0:1787118797.642343:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245248 00000100:00100000:2.0:1787118797.642389:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787118797.642410:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566245248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118797.642442:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118797.642480:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566245248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118797.642486:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787118797.642528:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245248:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787118797.683442:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787118797.683463:0:5863:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96136e9cb000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787118797.683468:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96136e95aa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96136e9cb780 00000020:00080000:1.0:1787118797.683472:0:5863:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff96136e95a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96136eb8f800 00000020:00080000:1.0:1787118797.683491:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787118797.683533:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787118797.683706:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787118797.694645:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787118797.694672:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1787118798.606030:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118798.640158:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118798.641855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240640 00000100:00100000:1.0:1787118798.641867:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240640 00000100:00100000:1.0:1787118798.641955:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 238 00000100:00100000:1.0:1787118798.641967:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:11333:x1873929544240640:12345-192.168.203.10@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787118798.642093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+19:11333:x1873929544240640:12345-192.168.203.10@tcp:60:lhsmtool_posix.0 Request processed in 128us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118798.642100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 238 00000100:00080000:3.0:1787118798.642676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118798.645048:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118798.645222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544240896 00000100:00100000:2.0:1787118798.645230:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544240896 00000100:00100000:2.0:1787118798.645284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 65 00000100:00100000:2.0:1787118798.645294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:11333:x1873929544240896:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787118798.645928:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+20:11333:x1873929544240896:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 634us (886us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787118798.645936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 65 00000100:00100000:0.0:1787118798.958666:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118798.958750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241024 00000100:00100000:1.0:1787118798.958758:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241024 00000100:00100000:1.0:1787118798.958826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 239 00000100:00100000:1.0:1787118798.958836:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+5:12131:x1873929544241024:12345-192.168.203.10@tcp:101:lsof.0 00010000:00010000:1.0:1787118798.958864:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118798.958884:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f9533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcd0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.958946:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.958958:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.958971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118798.959164:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787118798.959169:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118798.959257:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.959282:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f9533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcd0 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.959297:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcd0 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118798.959304:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:1.0:1787118798.959317:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787118798.959321:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9000, rc 0) 00000100:00100000:1.0:1787118798.959385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+6:12131:x1873929544241024:12345-192.168.203.10@tcp:101:lsof.0 Request processed in 550us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118798.959391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 239 00000100:00080000:3.0:1787118798.959986:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787118799.627177:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118800.603830:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118800.603895:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118800.603929:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118800.603956:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118800.603976:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118800.604002:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241408 00000100:00100000:3.0:1787118800.604010:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241408 00000100:00100000:3.0:1787118800.604070:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241536 00000100:00100000:3.0:1787118800.604073:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241536 00000100:00100000:3.0:1787118800.604094:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118800.604103:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544241408:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118800.604163:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2371:x1873929544241408:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 63us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118800.604170:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118800.604183:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00100000:3.0:1787118800.604188:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544241536:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118800.604206:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+5:2371:x1873929544241536:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 18us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118800.604211:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00080000:3.0:1787118800.604228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118800.604231:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118800.604315:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241152 00000100:00100000:0.0:1787118800.604319:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241152 00000100:00100000:0.0:1787118800.604361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 309 00000100:00100000:0.0:1787118800.604368:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544241152:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118800.604396:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:192bbd4a-7266-4705-8616-813bbeea405e+13:2371:x1873929544241152:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118800.604402:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 309 00000100:00100000:2.0:1787118800.604845:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241664 00000100:00100000:2.0:1787118800.604850:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241664 00000100:00100000:2.0:1787118800.604893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241280 00000100:00100000:2.0:1787118800.604897:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241280 00000100:00100000:2.0:1787118800.604919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:2.0:1787118800.604925:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2371:x1873929544241664:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118800.604959:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2371:x1873929544241664:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 35us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118800.604966:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 176 00000100:00100000:2.0:1787118800.604993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00100000:2.0:1787118800.604999:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+20:2371:x1873929544241280:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118800.605041:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b9d85e8-2500-4b81-a525-0303ce911299+20:2371:x1873929544241280:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 43us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118800.605048:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 177 00000100:00080000:0.0:1787118800.605156:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787118800.650293:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787118800.777973:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118800.777984:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118800.778267:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787118800.778274:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787118801.674143:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118801.739176:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245760:0@lo:400:kworker.0 00000100:00100000:2.0:1787118801.739245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118801.739312:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118801.739318:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566245632:0@lo:400:kworker.0 00000100:00100000:2.0:1787118801.739357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118801.739396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245632 00000100:00100000:2.0:1787118801.739404:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245632 00000100:00100000:2.0:1787118801.739454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787118801.739464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566245632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118801.739514:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566245632:12345-0@lo:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118801.739521:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787118801.739564:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566245632:0@lo:400:kworker.0 00000100:00080000:0.0:1787118801.739647:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118801.739759:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566245504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.739804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118801.739839:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566246016:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.739861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118801.739893:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787118801.739899:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566245376:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.739944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118801.739968:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566245888:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.739990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118801.740015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245376 00000100:00100000:3.0:1787118801.740019:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245376 00000100:00100000:3.0:1787118801.740044:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787118801.740051:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566245376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740102:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566245376:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118801.740110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787118801.740148:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245504 00000100:00100000:3.0:1787118801.740151:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245504 00000100:00100000:3.0:1787118801.740171:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245888 00000100:00100000:3.0:1787118801.740174:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245888 00000100:00100000:3.0:1787118801.740196:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787118801.740202:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566245504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740231:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566245504:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118801.740237:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787118801.740249:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787118801.740255:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566245888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740281:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873929566245888:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118801.740287:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787118801.740312:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566245376:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740322:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1873929566245888:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740339:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566245504:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740373:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566245760 00000100:00100000:3.0:1787118801.740376:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566245760 00000100:00100000:3.0:1787118801.740401:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246016 00000100:00100000:3.0:1787118801.740404:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246016 00000100:00100000:3.0:1787118801.740423:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787118801.740429:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566245760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740462:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566245760:12345-0@lo:400:kworker.0 Request processed in 34us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118801.740468:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787118801.740479:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787118801.740484:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566246016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740513:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566246016:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118801.740518:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787118801.740543:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566246016:0@lo:400:kworker.0 00000100:00100000:3.0:1787118801.740563:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787118801.740568:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96137f73dc00, transno 4294967322 00000004:00080000:3.0:1787118801.740576:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787118801.740590:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566245760:0@lo:400:kworker.0 00000100:00080000:0.0:1787118801.740806:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118801.740810:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118801.740812:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118802.250392:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566246144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118802.250460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118802.250987:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246144 00000100:00100000:2.0:1787118802.250996:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246144 00000100:00100000:2.0:1787118802.251057:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787118802.251067:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566246144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787118802.251104:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118802.251173:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566246144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118802.251187:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787118802.251278:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566246144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787118802.699875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118802.762086:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566246272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118802.762160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118802.762222:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246272 00000100:00100000:3.0:1787118802.762238:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246272 00000100:00100000:3.0:1787118802.762278:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787118802.762285:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566246272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118802.762315:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118802.762350:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566246272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118802.762357:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787118802.762394:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566246272:0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1787118802.829707:0:5863:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1787118802.829742:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787118802.829755:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787118802.829762:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1787118802.957249:0:12836:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:53:20 (1787118800) 00010000:00010000:0.0:1787118803.725294:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118804.746105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118805.725618:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118805.725660:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118805.725700:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118805.725764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241792 00000100:00100000:3.0:1787118805.725773:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241792 00000100:00100000:0.0:1787118805.725777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118805.725856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118805.725882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544242304 00000100:00100000:0.0:1787118805.725885:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544242304 00000100:00100000:0.0:1787118805.725930:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544241920 00000100:00100000:0.0:1787118805.725933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544241920 00000100:00100000:3.0:1787118805.725934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 311 00000100:00100000:3.0:1787118805.725942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544241792:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118805.725952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 181 00000100:00100000:0.0:1787118805.725958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2370:x1873929544242304:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118805.726007:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544241792:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118805.726015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 311 00000100:00100000:1.0:1787118805.726022:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544242048 00000100:00100000:1.0:1787118805.726026:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544242048 00000100:00100000:1.0:1787118805.726052:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544242176 00000100:00100000:1.0:1787118805.726055:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544242176 00000100:00100000:1.0:1787118805.726074:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 111 00000100:00100000:1.0:1787118805.726081:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2370:x1873929544242048:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118805.727022:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 182 00000100:00100000:2.0:1787118805.727043:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:2370:x1873929544241920:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118805.731617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2370:x1873929544242304:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 5646us (5904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118805.731634:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 181 00000100:00100000:0.0:1787118805.731692:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00100000:0.0:1787118805.731706:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2370:x1873929544242176:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118805.731769:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2370:x1873929544242176:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 69us (5912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118805.731775:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 112 00000100:00080000:0.0:1787118805.731795:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787118805.731810:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787118805.731813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118805.733631:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b9d85e8-2500-4b81-a525-0303ce911299+7:2370:x1873929544242048:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 7542us (7960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118805.733654:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 111 00000100:00100000:2.0:1787118805.733756:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+19:2370:x1873929544241920:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 6721us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118805.733766:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 182 00010000:00010000:2.0:1787118805.770008:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118806.794037:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118806.859048:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566246656:0@lo:400:kworker.0 00000100:00100000:1.0:1787118806.859109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118806.859170:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118806.859175:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566246784:0@lo:400:kworker.0 00000100:00100000:1.0:1787118806.859195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118806.859223:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246784 00000100:00100000:1.0:1787118806.859228:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246784 00000100:00100000:1.0:1787118806.859277:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787118806.859286:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118806.859329:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566246784:12345-0@lo:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118806.859336:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787118806.859673:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246656 00000100:00100000:0.0:1787118806.859678:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246656 00000100:00100000:0.0:1787118806.859708:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787118806.859715:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566246656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118806.859781:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873929566246656:12345-0@lo:400:kworker.0 Request processed in 66us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118806.859786:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787118806.859847:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566246784:0@lo:400:kworker.0 00000100:00100000:0.0:1787118806.859858:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1873929566246656:0@lo:400:kworker.0 00000100:00080000:1.0:1787118806.859915:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118806.859921:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118806.860167:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566246400:0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118806.860278:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566246912:0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118806.860318:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787118806.860332:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566246528:0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118806.860383:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566247040:0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118806.860427:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246912 00000100:00100000:3.0:1787118806.860431:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246912 00000100:00100000:3.0:1787118806.860454:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246528 00000100:00100000:3.0:1787118806.860456:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246528 00000100:00100000:3.0:1787118806.860470:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787118806.860476:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566246912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860511:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566246912:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118806.860517:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787118806.860529:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787118806.860535:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566246528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860559:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566246528:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118806.860565:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787118806.860586:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566246528:0@lo:400:kworker.0 00000100:00100000:3.0:1787118806.860594:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566246912:0@lo:400:kworker.0 00000100:00100000:0.0:1787118806.860746:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247040 00000100:00100000:0.0:1787118806.860750:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247040 00000100:00100000:0.0:1787118806.860775:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787118806.860782:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566247040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118806.860836:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566247040:12345-0@lo:400:kworker.0 Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118806.860842:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787118806.860938:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566247040:0@lo:400:kworker.0 00000100:00100000:1.0:1787118806.861571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566246400 00000100:00100000:1.0:1787118806.861576:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566246400 00000100:00100000:1.0:1787118806.861616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787118806.861624:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566246400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118806.861676:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3298:x1873929566246400:12345-0@lo:400:kworker.0 Request processed in 54us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118806.861682:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:1.0:1787118806.861709:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787118806.861713:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118806.861967:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566246400:0@lo:400:kworker.0 00000100:00100000:1.0:1787118807.370141:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118807.375005:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566247168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118807.375773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118807.377757:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247168 00000100:00100000:3.0:1787118807.377770:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247168 00000100:00100000:3.0:1787118807.377844:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787118807.378552:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566247168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118807.378592:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118807.378817:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566247168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 964us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118807.378835:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787118807.379181:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566247168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118807.506609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118807.510107:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544242560 00000100:00100000:2.0:1787118807.510121:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544242560 00000100:00100000:2.0:1787118807.510259:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 66 00000100:00100000:2.0:1787118807.510277:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+19:12352:x1873929544242560:12345-192.168.203.10@tcp:35:umount.0 00000100:00100000:2.0:1787118807.510852:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+20:12352:x1873929544242560:12345-192.168.203.10@tcp:35:umount.0 Request processed in 581us (4367us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787118807.510861:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 66 00000100:00080000:1.0:1787118807.514390:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118807.518498:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118807.518578:0:12487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544242816 00000100:00100000:3.0:1787118807.518588:0:12487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544242816 00000100:00100000:3.0:1787118807.518649:0:12487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:3.0:1787118807.518659:0:12487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+20:12352:x1873929544242816:12345-192.168.203.10@tcp:35:umount.0 00000100:00100000:3.0:1787118807.519061:0:12487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b9d85e8-2500-4b81-a525-0303ce911299+21:12352:x1873929544242816:12345-192.168.203.10@tcp:35:umount.0 Request processed in 403us (587us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787118807.519069:0:12487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 67 00000100:00100000:0.0:1787118807.521900:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118807.522062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243072 00000100:00100000:3.0:1787118807.522070:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243072 00000100:00100000:3.0:1787118807.522124:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:3.0:1787118807.522133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96135dbd4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+21:12352:x1873929544243072:12345-192.168.203.10@tcp:35:umount.0 00000100:00100000:3.0:1787118807.522836:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96135dbd4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b9d85e8-2500-4b81-a525-0303ce911299+22:12352:x1873929544243072:12345-192.168.203.10@tcp:35:umount.0 Request processed in 702us (946us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787118807.522853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 68 00000100:00100000:0.0:1787118807.535580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118807.535714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243328 00000100:00100000:2.0:1787118807.535754:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243328 00000100:00100000:2.0:1787118807.535822:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:2.0:1787118807.535832:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+22:12352:x1873929544243328:12345-192.168.203.10@tcp:35:umount.0 00000100:00100000:2.0:1787118807.536156:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b9d85e8-2500-4b81-a525-0303ce911299+23:12352:x1873929544243328:12345-192.168.203.10@tcp:35:umount.0 Request processed in 324us (585us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787118807.536164:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 69 00000100:00100000:1.0:1787118807.550772:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118807.550818:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118807.550835:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118807.551129:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243712 00000100:00100000:0.0:1787118807.551139:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243712 00000100:00100000:0.0:1787118807.551195:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243584 00000100:00100000:0.0:1787118807.551198:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243584 00000100:00100000:0.0:1787118807.551210:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243456 00000100:00100000:0.0:1787118807.551213:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243456 00000100:00100000:0.0:1787118807.551230:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:0.0:1787118807.551239:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350047450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+15:2368:x1873929544243712:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118807.551282:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118807.551302:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986600/0xaa534e3c784f87c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b926 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118807.551318:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118807.551370:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350047450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+14:2368:x1873929544243712:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 132us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118807.551378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:0.0:1787118807.551427:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:0.0:1787118807.551434:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+13:2370:x1873929544243584:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118807.551442:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118807.551451:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8de00/0xaa534e3c784f8518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b823 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118807.551460:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118807.551477:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+12:2370:x1873929544243584:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118807.551610:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118807.551684:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:0.0:1787118807.551699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:0.0:1787118807.551706:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+11:2371:x1873929544243456:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118807.551713:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118807.551752:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382174600/0xaa534e3c784f85b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b85b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118807.551762:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118807.551783:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:192bbd4a-7266-4705-8616-813bbeea405e+10:2371:x1873929544243456:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 78us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118807.551808:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:0.0:1787118807.551861:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544243840 00000100:00100000:0.0:1787118807.551865:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544243840 00000100:00100000:0.0:1787118807.551902:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 72 00000100:00100000:0.0:1787118807.551908:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+5:2367:x1873929544243840:12345-192.168.203.10@tcp:9:umount.0 00000020:00000080:0.0:1787118807.551930:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f888a 00000100:00080000:0.0:1787118807.551938:0:6704:0:(import.c:65:import_set_state_nolock()) ffff96136e9ba800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787118807.551974:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787118807.552200:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b9d85e8-2500-4b81-a525-0303ce911299+2:2367:x1873929544243840:12345-192.168.203.10@tcp:9:umount.0 Request processed in 290us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118807.552207:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 72 00010000:00010000:0.0:1787118807.552225:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787118807.552241:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118807.566524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118807.566608:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544244224 00000100:00100000:2.0:1787118807.566617:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544244224 00000100:00100000:2.0:1787118807.566701:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 73 00000100:00100000:2.0:1787118807.566717:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+7:2367:x1873929544244224:12345-192.168.203.10@tcp:9:umount.0 00000020:00000080:2.0:1787118807.566794:0:6703:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8aeb 00000020:00010000:2.0:1787118807.566803:0:6703:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9613431e5000: total 0 00000100:00080000:2.0:1787118807.566808:0:6703:0:(import.c:65:import_set_state_nolock()) ffff9613431e7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787118807.566848:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787118807.567102:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b9d85e8-2500-4b81-a525-0303ce911299+5:2367:x1873929544244224:12345-192.168.203.10@tcp:9:umount.0 Request processed in 392us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118807.567110:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 73 00000100:00080000:0.0:1787118807.567671:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1787118807.567750:0:5830:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9613431e5000: total 0 00010000:00010000:1.0:1787118807.567784:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9613431e5000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787118807.567850:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f8e8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bafb expref: 4 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118807.567882:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafd4c4c/0xaa534e3c784f952c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc9 expref: 3 pid: 8419 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118807.567895:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9613431e5000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787118807.567905:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118807.567907:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118807.567909:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118807.582946:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118807.583032:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544245248 00000100:00100000:3.0:1787118807.583041:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544245248 00000100:00100000:3.0:1787118807.583103:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 240 00000100:00100000:3.0:1787118807.583114:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+23:2367:x1873929544245248:12345-192.168.203.10@tcp:39:umount.0 00000020:00000080:3.0:1787118807.583146:0:7892:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8526 00000020:00010000:3.0:1787118807.583168:0:7892:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96137f889800: total 0 00000100:00080000:3.0:1787118807.583173:0:7892:0:(import.c:65:import_set_state_nolock()) ffff96137a3d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787118807.583250:0:7892:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787118807.583636:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b9d85e8-2500-4b81-a525-0303ce911299+22:2367:x1873929544245248:12345-192.168.203.10@tcp:39:umount.0 Request processed in 524us (698us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787118807.583660:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 240 00000020:00010000:2.0:1787118807.584361:0:8462:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96137f889800: total 0 00010000:00010000:2.0:1787118807.584420:0:8462:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96137f889800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1787118807.584454:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118807.584457:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787118807.584465:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9200/0xaa534e3c784f9517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcc2 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584548:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118807.584551:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118807.584556:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f8e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bae6 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584571:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118807.584573:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787118807.584576:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f8e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baf4 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584588:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118807.584589:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118807.584603:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042800/0xaa534e3c784f94df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcb4 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584619:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118807.584621:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118807.584624:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f8b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2ba22 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584636:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961351704000) 00010000:00010000:2.0:1787118807.584638:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118807.584642:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961340031800/0xaa534e3c784f87f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b934 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584662:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118807.584664:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118807.584668:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961382042400/0xaa534e3c784f91eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bbf0 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584678:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96134bc94d00) 00010000:00010000:2.0:1787118807.584680:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787118807.584684:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f8860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b950 expref: 14 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584698:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118807.584700:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118807.584703:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f940d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bc7c expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584713:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff961351704b00) 00010000:00010000:2.0:1787118807.584749:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118807.584754:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9a00/0xaa534e3c784f9509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcbb expref: 12 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584772:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff961351704600) 00010000:00010000:2.0:1787118807.584775:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787118807.584778:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f8f0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb1e expref: 11 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584803:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff96134bc94f00) 00010000:00010000:2.0:1787118807.584806:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118807.584810:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986200/0xaa534e3c784f8d6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2baae expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584824:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:2.0:1787118807.584826:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118807.584831:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9e00/0xaa534e3c784f8ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bb17 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584842:0:8462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961359bc8b00) 00010000:00010000:2.0:1787118807.584844:0:8462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118807.584848:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f880c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b93b expref: 8 pid: 7892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118807.584860:0:8462:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96137f889800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787118807.584878:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118807.584880:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118807.584881:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118807.818120:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118807.883218:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118807.883262:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566247296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118807.883331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118807.883409:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247296 00000100:00100000:2.0:1787118807.883421:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247296 00000100:00100000:2.0:1787118807.883474:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787118807.883486:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566247296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118807.883522:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118807.883586:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566247296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118807.883595:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787118807.883647:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566247296:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787118807.935034:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787118807.935057:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000001:00080000:2.0:1787118807.935066:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787118807.935073:0:5863:0:(genops.c:906:class_export_put()) final put ffff96137f889800/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:2.0:1787118807.935097:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f889800/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-MDT0000 00000020:00000080:2.0:1787118807.935162:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137a3d3800 for lustre-MDT0000 00000001:00100000:0.0:1787118807.958190:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:0.0:1787118807.958198:0:6728:0:(genops.c:906:class_export_put()) final put ffff9613431e5000/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:2.0:1787118807.958287:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9613431e5000/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-OST0000 00000020:00000080:2.0:1787118807.958339:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9613431e7000 for lustre-OST0000 00010000:00010000:0.0:1787118808.846182:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787118808.972346:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:1.0:1787118808.972356:0:7647:0:(genops.c:906:class_export_put()) final put ffff96136e9b8000/4b9d85e8-2500-4b81-a525-0303ce911299 00000020:00000080:3.0:1787118808.972440:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136e9b8000/4b9d85e8-2500-4b81-a525-0303ce911299 for lustre-OST0001 00000020:00000080:3.0:1787118808.972489:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136e9ba800 for lustre-OST0001 00000100:00100000:2.0:1787118809.510154:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118809.510256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118809.510408:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118809.514592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544245376 00000100:00100000:0.0:1787118809.514606:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544245376 00000100:00100000:0.0:1787118809.514747:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544245632 00000100:00100000:0.0:1787118809.514752:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544245632 00000100:00100000:2.0:1787118809.515806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544245504 00000100:00100000:2.0:1787118809.515813:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544245504 00000100:00100000:2.0:1787118809.515858:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:2.0:1787118809.515869:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+12:2369:x1873929544245376:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118809.515901:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118809.515918:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031a00/0xaa534e3c784f85ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b89a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118809.515932:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118809.515980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+11:2369:x1873929544245376:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 114us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118809.515985:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:2.0:1787118809.516013:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:2.0:1787118809.516022:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+10:2370:x1873929544245632:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118809.516030:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118809.516039:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8d600/0xaa534e3c784f85f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b870 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118809.516048:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118809.516066:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+9:2370:x1873929544245632:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 47us (5810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118809.516073:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:2.0:1787118809.516084:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:2.0:1787118809.516091:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+8:2369:x1873929544245504:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118809.516099:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118809.516108:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8d200/0xaa534e3c784f87a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b91f expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118809.516117:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118809.516139:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:192bbd4a-7266-4705-8616-813bbeea405e+7:2369:x1873929544245504:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 49us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118809.516151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:1.0:1787118809.530340:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118809.531441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544245888 00000100:00100000:0.0:1787118809.531451:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544245888 00000100:00100000:0.0:1787118809.531539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 241 00000100:00100000:0.0:1787118809.531551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+6:2367:x1873929544245888:12345-192.168.203.10@tcp:39:umount.0 00000020:00000080:0.0:1787118809.531592:0:5843:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f860d 00000020:00010000:0.0:1787118809.531612:0:5843:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96136eb52000: total 0 00000100:00080000:0.0:1787118809.531616:0:5843:0:(import.c:65:import_set_state_nolock()) ffff96136eb55000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787118809.531643:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1787118809.531755:0:5830:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96136eb52000: total 0 00010000:00010000:2.0:1787118809.531824:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96136eb52000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787118809.531859:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b200) 00010000:00010000:2.0:1787118809.531863:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118809.531870:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f953a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcd0 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118809.531908:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96136eb52000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787118809.531920:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118809.531921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118809.531923:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787118809.532708:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118809.533381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dad2de5-fb67-450e-b561-ceddc9effe30+3:2367:x1873929544245888:12345-192.168.203.10@tcp:39:umount.0 Request processed in 1821us (3039us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787118809.533392:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 241 00000100:00100000:2.0:1787118809.579432:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118809.580180:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246144 00000100:00100000:3.0:1787118809.580191:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246144 00000100:00100000:3.0:1787118809.580252:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 313 00000100:00100000:3.0:1787118809.580261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+7:2367:x1873929544246144:12345-192.168.203.10@tcp:251:umount.0 00000020:00000080:3.0:1787118809.580304:0:5836:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8503 00000020:00010000:3.0:1787118809.580311:0:5836:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96137f88a800: total 0 00000100:00080000:3.0:1787118809.580315:0:5836:0:(import.c:65:import_set_state_nolock()) ffff96137f888000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787118809.580511:0:8462:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96137f88a800: total 0 00010000:00010000:2.0:1787118809.580515:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118809.580564:0:8462:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96137f88a800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787118809.580596:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030a00/0xaa534e3c784f85b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2b862 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118809.580613:0:8462:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96137f88a800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787118809.580624:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118809.580626:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118809.580628:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118809.581121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350890850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:192bbd4a-7266-4705-8616-813bbeea405e+1:2367:x1873929544246144:12345-192.168.203.10@tcp:251:umount.0 Request processed in 859us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118809.581131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 313 00000020:00000080:3.0:1787118809.581141:0:5836:0:(genops.c:906:class_export_put()) final put ffff96137f88a800/192bbd4a-7266-4705-8616-813bbeea405e 00000020:00000080:2.0:1787118809.581348:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f88a800/192bbd4a-7266-4705-8616-813bbeea405e for MGS 00000020:00000080:2.0:1787118809.581397:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f888000 for MGS 00010000:00010000:3.0:1787118809.865976:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118810.894505:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787118810.958332:0:13036:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787118810.968032:0:13036:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787118810.968074:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.968103:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.968111:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.968118:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.968142:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787118810.968147:0:13036:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787118810.968169:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787118810.968174:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787118810.968179:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787118810.968200:0:13036:0:(import.c:65:import_set_state_nolock()) ffff961375694800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787118810.968261:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118810.968269:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118810.968284:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566247424:0@lo:39:umount.0 00010000:00010000:1.0:1787118810.968286:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382175600 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118810.968290:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.968297:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118810.968304:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118810.968308:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787118810.968310:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787118810.968313:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787118810.968334:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.968339:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787118810.968342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787118810.968366:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.968373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382175600/0xaa534e3c784f8588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f858f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.968383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118810.968385:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118810.968386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118810.968397:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787118810.968496:0:7892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247424 00000100:00100000:2.0:1787118810.968503:0:7892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247424 00000100:00100000:2.0:1787118810.968555:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787118810.968565:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873929566247424:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787118810.968588:0:7892:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8312 00000100:00100000:1.0:1787118810.968589:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566247552:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787118810.968594:0:7892:0:(import.c:65:import_set_state_nolock()) ffff96136e5c5800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787118810.968618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118810.968653:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1873929566247424:12345-0@lo:39:umount.0 Request processed in 90us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118810.968658:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247552 00000100:00100000:2.0:1787118810.968660:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787118810.968661:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247552 00000020:00000080:2.0:1787118810.968668:0:7892:0:(genops.c:906:class_export_put()) final put ffff96136e5c4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787118810.968689:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136e5c4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1787118810.968691:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787118810.968697:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+19:3299:x1873929566247552:12345-0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787118810.968775:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136e5c5800 for lustre-MDT0000 00010000:00010000:0.0:1787118810.968794:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118810.968823:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118810.968837:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340030c00/0xaa534e3c784f858f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8588 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787118810.968846:0:3297:0:(import.c:65:import_set_state_nolock()) ffff961375694800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1787118810.968847:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118810.968859:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566247424:0@lo:39:umount.0 00000100:00100000:1.0:1787118810.968909:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3299:x1873929566247552:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118810.968915:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787118810.968956:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787118810.968959:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787118810.968962:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787118810.968962:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566247552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118810.970110:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970120:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970124:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970127:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970224:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118810.970229:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970233:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970237:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.970240:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971377:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787118810.971387:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971395:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8200 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118810.971399:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971427:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118810.971445:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118810.971455:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787118810.971459:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787118810.971493:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.971493:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118810.971503:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118810.971506:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971526:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.971534:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971536:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c8200/0xaa534e3c784f8596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f859d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.971553:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971561:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118810.971566:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118810.971572:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971576:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118810.971582:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971590:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118810.971596:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118810.971608:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787118810.971610:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787118810.971613:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787118810.971628:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971633:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118810.971652:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118810.971660:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971661:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.971678:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030000 already unused, calling callback (ffffffffc1af0c20) 00010000:00010000:3.0:1787118810.971680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8c400/0xaa534e3c784f84bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f84c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118810.971681:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566247808:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1787118810.971682:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.971703:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971708:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1787118810.971709:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118810.971711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118810.971715:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787118810.971719:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787118810.971749:0:8464:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00100000:3.0:1787118810.971761:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787118810.971776:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.971784:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787118810.971786:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961242ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566247680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118810.971792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787118810.971809:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.971819:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118810.971821:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118810.971824:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118810.971847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118810.971861:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787118810.971869:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566247936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118810.971894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118810.971929:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247808 00000100:00100000:1.0:1787118810.971935:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247808 00000100:00100000:1.0:1787118810.971970:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247680 00000100:00100000:1.0:1787118810.971972:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247680 00000100:00100000:1.0:1787118810.971982:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566247936 00000100:00100000:1.0:1787118810.971983:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566247936 00000100:00100000:1.0:1787118810.971997:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787118810.972005:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350046450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3300:x1873929566247808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787118810.972012:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787118810.972018:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787118810.972023:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+20:3298:x1873929566247680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118810.972033:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8c200/0xaa534e3c784f84c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f84bd expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.972034:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118810.972062:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382175200/0xaa534e3c784f859d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8596 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.972063:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118810.972078:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118810.972102:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350046450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3300:x1873929566247808:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118810.972111:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787118810.972119:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+18:3298:x1873929566247680:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118810.972128:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787118810.972149:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787118810.972156:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+16:3300:x1873929566247936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118810.972165:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118810.972176:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986c00/0xaa534e3c784f87bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f87b8 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.972185:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118810.972192:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566247808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787118810.972230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3300:x1873929566247936:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118810.972235:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566247936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787118810.972242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787118810.972597:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961242ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566247680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118810.972819:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118810.972997:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787118810.973003:0:13036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961340030000/0xaa534e3c784f87b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118810.973016:0:13036:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787118810.973802:0:13036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.973829:0:13036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.973836:0:13036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.973843:0:13036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.974087:0:13036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787118810.974092:0:13036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787118810.974096:0:13036:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787118810.974124:0:13036:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787118810.974128:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787118810.974132:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787118810.974138:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787118810.974144:0:13036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96124339e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787118810.974150:0:13036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96136e4dd800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787118810.974156:0:13036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff96136eb52000 8dad2de5-fb67-450e-b561-ceddc9effe30 192.168.203.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787118810.974161:0:13036:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9613462619c0) has exports, disconnecting them 00000020:00080000:0.0:1787118810.974165:0:13036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96124339e800), last request at 1787118806 00000020:00000080:0.0:1787118810.974172:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8485 00000100:00080000:0.0:1787118810.974186:0:13036:0:(import.c:65:import_set_state_nolock()) ffff96124339c800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787118810.978585:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118810.978599:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.978612:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382043400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118810.978617:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.978627:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118810.978636:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118810.978642:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787118810.978645:0:8462:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787118810.978648:0:8462:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787118810.978690:0:8462:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.978697:0:8462:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1787118810.978714:0:13036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96124339e800): rc 0 00000020:00000080:0.0:1787118810.978752:0:13036:0:(genops.c:906:class_export_put()) final put ffff96124339e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787118810.978779:0:13036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96136e4dd800), last request at 1787118806 00000020:00000080:0.0:1787118810.978787:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f83ba 00000100:00080000:0.0:1787118810.978805:0:13036:0:(import.c:65:import_set_state_nolock()) ffff96136e4d8800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787118810.978807:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.978817:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382043400/0xaa534e3c784f8271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8278 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118810.978823:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118810.978834:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787118810.978835:0:13036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96136e4dd800): rc 0 00010000:00010000:1.0:1787118810.978837:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787118810.978840:0:13036:0:(genops.c:906:class_export_put()) final put ffff96136e4dd800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1787118810.978841:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787118810.978848:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96124339e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1787118810.978858:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00000080:0.0:1787118810.978867:0:13036:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa89d41c57ae0 00000100:00100000:1.0:1787118810.978877:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566248064:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787118810.978887:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96136e4dd800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1787118810.978887:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787118810.978893:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:1.0:1787118810.978938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118810.979009:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248064 00000004:00080000:0.0:1787118810.979011:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787118810.979015:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248064 00000100:00080000:0.0:1787118810.979075:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787118810.979088:0:13036:0:(import.c:65:import_set_state_nolock()) ffff96137f860000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787118810.979099:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787118810.979102:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787118810.979112:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1787118810.979119:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96124339c800 for lustre-MDT0000 00000020:00000080:2.0:1787118810.979125:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136e4d8800 for lustre-MDT0000 00000100:00100000:3.0:1787118810.979153:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566248192:0@lo:9:umount.0 00000100:00080000:0.0:1787118810.979175:0:13036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787118810.979186:0:13036:0:(import.c:65:import_set_state_nolock()) ffff9612423d4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787118810.979197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787118810.979217:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9613462619c0) has no exports 00000100:00100000:3.0:1787118810.979233:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566248320:0@lo:9:umount.0 00000100:00100000:3.0:1787118810.979253:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118810.979333:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118810.979428:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248192 00000100:00100000:0.0:1787118810.979433:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248192 00000100:00100000:0.0:1787118810.979647:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248320 00000100:00100000:0.0:1787118810.979651:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248320 00000100:00100000:0.0:1787118810.979674:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787118810.979678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787118810.979683:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118810.979684:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1873929566248192:12345-0@lo:9:umount.0 00000100:00100000:3.0:1787118810.979704:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000020:00000080:0.0:1787118810.979708:0:6705:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8407 00000100:00080000:0.0:1787118810.979715:0:6705:0:(import.c:65:import_set_state_nolock()) ffff96137f88f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787118810.979863:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961242ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1873929566248320:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787118810.979878:0:8419:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f84fc 00000100:00080000:3.0:1787118810.979883:0:8419:0:(import.c:65:import_set_state_nolock()) ffff96137a3d4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787118810.980054:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000001:00000004:3.0:1787118810.980058:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787118810.980111:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118810.980464:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3297:x1873929566248320:12345-0@lo:9:umount.0 Request processed in 743us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118810.980471:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787118810.980747:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961242ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3297:x1873929566248192:12345-0@lo:9:umount.0 Request processed in 1065us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118810.980755:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787118810.980866:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9612423d4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787118810.980880:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787118810.980883:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787118810.980886:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566248320:0@lo:9:umount.0 00000100:00080000:2.0:1787118810.980899:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96137f860000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787118810.980924:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787118810.980927:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787118810.980930:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566248192:0@lo:9:umount.0 00000100:00100000:1.0:1787118810.981177:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118810.981189:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+15:3299:x1873929566248064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118810.981201:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118810.981218:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9613414b1200/0xaa534e3c784f8278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8271 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118810.981234:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118810.981276:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3299:x1873929566248064:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118810.981283:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787118810.981303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118810.981340:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566248064:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787118810.992106:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9613462619c0) has no exports 00000020:00000080:0.0:1787118811.040808:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f82cc 00000020:00000080:0.0:1787118811.040824:0:13036:0:(genops.c:906:class_export_put()) final put ffff96136e4da000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787118811.040844:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787118811.040907:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136e4da000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787118811.041145:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787118811.041157:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787118811.041162:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff96137abcb380) has no exports 00000020:00000080:1.0:1787118811.041526:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f82c5 00000020:00000080:1.0:1787118811.041533:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137b484000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787118811.041587:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137b484000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787118811.041607:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787118811.041616:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787118811.041619:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137abd0000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787118811.041622:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff96137abd0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787118811.041632:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787118811.914159:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118811.980283:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118811.980307:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566248448:0@lo:400:kworker.0 00000100:00100000:3.0:1787118811.980375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118811.980440:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566248704:0@lo:400:kworker.0 00000100:00100000:3.0:1787118811.980471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118811.980493:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787118811.980499:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566248576:0@lo:400:kworker.0 00000100:00100000:3.0:1787118811.980521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118811.980549:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248704 00000100:00100000:3.0:1787118811.980555:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248704 00000100:00100000:3.0:1787118811.980588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248576 00000100:00100000:3.0:1787118811.980591:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248576 00000100:00100000:3.0:1787118811.980609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787118811.980629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1873929566248704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787118811.980636:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787118811.980676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1873929566248704:12345-0@lo:400:kworker.0 Request processed in 58us (203us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787118811.980682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787118811.980696:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787118811.980700:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1873929566248576:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787118811.980738:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787118811.980773:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1873929566248576:12345-0@lo:400:kworker.0 Request processed in 71us (252us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787118811.980779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787118811.980832:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787118811.980836:0:3301:0:(import.c:65:import_set_state_nolock()) ffff96137f88f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787118811.980840:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787118811.982150:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248448 00000100:00100000:2.0:1787118811.982157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248448 00000100:00100000:2.0:1787118811.982212:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787118811.982221:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3298:x1873929566248448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118811.982285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961350893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82+14:3298:x1873929566248448:12345-0@lo:400:kworker.0 Request processed in 66us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118811.982293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787118811.982347:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3298:1873929566248448:0@lo:400:kworker.0 00000100:00080000:3.0:1787118812.005325:0:3301:0:(import.c:65:import_set_state_nolock()) ffff96137f88f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787118812.005339:0:3301:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 165 00000100:00080000:3.0:1787118812.005348:0:3301:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96137f88f000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118812.005388:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96136e2c4700 x1873929566248832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118812.005426:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566248576:0@lo:400:kworker.0 00000100:00080000:3.0:1787118812.005458:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787118812.005462:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787118812.005465:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787118812.005469:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787118812.005478:0:3301:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787118812.005482:0:3301:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9613501ce000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118812.005530:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96124139b800 x1873929566248960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118812.005542:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566248704:0@lo:400:kworker.0 00000100:00100000:0.0:1787118812.005846:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566248832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787118812.005907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118812.005937:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566248960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787118812.005959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118812.006389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248832 00000100:00100000:2.0:1787118812.006397:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248832 00000100:00100000:2.0:1787118812.006434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566248960 00000100:00100000:2.0:1787118812.006437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566248960 00000100:00100000:2.0:1787118812.006460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787118812.006467:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566248832:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787118812.006481:0:5843:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787118812.006716:0:7892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787118812.006744:0:7892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3297:x1873929566248960:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787118812.006752:0:7892:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787118812.006807:0:7892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3297:x1873929566248960:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 84us (846us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787118812.006813:0:7892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787118812.006847:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787118812.006851:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787118812.006854:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566248960:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787118812.026032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566248832:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 19559us (20119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787118812.026046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787118812.028372:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96137f88f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787118812.028384:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787118812.028389:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566248832:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787118812.938115:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787118813.056686:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8dad2de5-fb67-450e-b561-ceddc9effe30 00000001:00080000:2.0:1787118813.056703:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787118813.056709:0:5863:0:(genops.c:906:class_export_put()) final put ffff96136eb52000/8dad2de5-fb67-450e-b561-ceddc9effe30 00000001:00100000:0.0:1787118813.056817:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787118813.056821:0:6728:0:(genops.c:906:class_export_put()) final put ffff96137f88e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787118813.057200:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb52000/8dad2de5-fb67-450e-b561-ceddc9effe30 for lustre-MDT0000 00000020:00000080:1.0:1787118813.057268:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f88e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787118813.057287:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96136eb55000 for lustre-MDT0000 00000020:00000080:1.0:1787118813.057291:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f88f800 for lustre-OST0000 00000020:01000000:1.0:1787118813.066195:0:13036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff961350043b40 - data ffff96137fcc2360/ffff961242957000 00000020:01000000:1.0:1787118813.066334:0:13036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9613657fe300 - data ffff961371193288/ffff96136e5bb000 00000001:00000004:1.0:1787118813.075157:0:13036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787118813.166167:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787118813.166175:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787118813.166268:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787118813.166272:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787118813.167338:0:7005:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787118813.167344:0:7005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787118813.167355:0:7005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787118813.168429:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787118813.168435:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787118813.168454:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787118813.168457:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787118813.168990:0:7937:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787118813.169005:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787118813.169016:0:7937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787118813.271906:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8294 00000020:00000080:3.0:1787118813.271917:0:13036:0:(genops.c:906:class_export_put()) final put ffff9613756d1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787118813.272574:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9613756d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787118813.273326:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f82a9 00000020:00000080:2.0:1787118813.273338:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137abd0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787118813.273413:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787118813.273419:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787118813.273427:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787118813.273432:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff961346260000) has no exports 00000020:00000080:3.0:1787118813.273440:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137abd0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787118813.273636:0:13036:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787118813.273645:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f84e7 00000020:00000080:2.0:1787118813.273650:0:13036:0:(genops.c:906:class_export_put()) final put ffff9612423d3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787118813.273663:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787118813.273668:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787118813.273674:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787118813.273677:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff96137a6b3380) has no exports 00000020:00000080:2.0:1787118813.273684:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f84e0 00000020:00000080:2.0:1787118813.273688:0:13036:0:(genops.c:906:class_export_put()) final put ffff9612423d6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787118813.273704:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9612423d3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787118813.273718:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9612423d6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787118813.274396:0:13036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787118813.274402:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787118813.274406:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787118813.274411:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787118813.274413:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787118813.274451:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118813.274459:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787118813.274465:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8400 00000020:00000080:2.0:1787118813.274469:0:13036:0:(genops.c:906:class_export_put()) final put ffff9613462bd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787118813.274473:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787118813.274477:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787118813.274481:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787118813.274484:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff96137abc8000) has no exports 00000020:00000080:2.0:1787118813.274487:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f83f9 00000020:00000080:2.0:1787118813.274500:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137f860800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787118813.274517:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9612423d4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787118813.274525:0:36:0:(genops.c:906:class_export_put()) final put ffff96136eb53000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787118813.274528:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787118813.274535:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787118813.274619:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9613462bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787118813.274626:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f860800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787118813.274999:0:13036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787118813.275003:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787118813.275006:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787118813.275010:0:13036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787118813.275012:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787118813.275055:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f860000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787118813.275056:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118813.275064:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787118813.275068:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137f863800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787118813.275071:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f863800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787118813.275077:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787118813.275221:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118813.275226:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787118813.275229:0:13036:0:(genops.c:906:class_export_put()) final put ffff9613756d4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787118813.275231:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff9613756d4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787118813.275236:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787118813.275390:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f82b0 00000020:00000080:2.0:1787118813.275398:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137abd5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787118813.275409:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787118813.275413:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787118813.275417:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787118813.275427:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff96137abccd40) has no exports 00000020:00000080:2.0:1787118813.275445:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118813.275449:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787118813.275453:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f82b7 00000020:00000080:2.0:1787118813.275456:0:13036:0:(genops.c:906:class_export_put()) final put ffff96137abd6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787118813.275458:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137abd5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787118813.275465:0:36:0:(genops.c:906:class_export_put()) final put ffff96134654b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787118813.275468:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96134654b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1787118813.275468:0:13036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961347c3c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787118813.275474:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961347c3c800 3 00000020:01000000:3.0:1787118813.275477:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787118813.275479:0:13036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff961347c3c800 from lustre-MDT0000 00000020:00000080:2.0:1787118813.275497:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118813.275501:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787118813.275504:0:13036:0:(genops.c:906:class_export_put()) final put ffff9613756d2000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787118813.275512:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff9613756d2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787118813.275519:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787118813.275558:0:13036:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787118813.275561:0:13036:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787118813.275563:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787118813.275565:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787118813.275567:0:13036:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787118813.275572:0:13036:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff961345568000 f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787118813.275576:0:13036:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff961346514d40) has exports, disconnecting them 00000020:00080000:2.0:1787118813.275580:0:13036:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff961345568000), last request at 1787118567 00000020:00000080:2.0:1787118813.275592:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8255 00000020:00010000:2.0:1787118813.275595:0:13036:0:(genops.c:1942:obd_stale_export_put()) Put export ffff961345568000: total 2 00000100:00080000:2.0:1787118813.275598:0:13036:0:(import.c:65:import_set_state_nolock()) ffff96134556b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787118813.275610:0:13036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff961345568000): rc 0 00000020:00080000:2.0:1787118813.275613:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff961346514d40) has no exports 00000020:00010000:2.0:1787118813.275647:0:8464:0:(genops.c:1928:obd_stale_export_get()) Get export ffff961345568000: total 2 00010000:00010000:2.0:1787118813.275675:0:8464:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961345568000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787118813.275701:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f879c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8795 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275719:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382175e00/0xaa534e3c784f836d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8366 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275764:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f85ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f85a4 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275779:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961340031000/0xaa534e3c784f87b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f87aa expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787118813.275789:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137abd6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787118813.275796:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8c800/0xaa534e3c784f8557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f8550 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275821:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f8565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f855e expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275833:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8400/0xaa534e3c784f8573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f856c expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275846:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382174400/0xaa534e3c784f8581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa534e3c784f857a expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118813.275859:0:8464:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961345568000, canceled 8 locks, left on hash table 0. 00000100:00100000:1.0:1787118813.275867:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9613657eae00:5836] 2 exiting: rc = 0 00000020:00000080:2.0:1787118813.275875:0:8464:0:(genops.c:906:class_export_put()) final put ffff961345568000/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 00010000:00010000:2.0:1787118813.275895:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118813.275897:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118813.275899:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787118813.275916:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff961345568000/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 for MGS 00000100:00100000:2.0:1787118813.275923:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9613515d5000:5835] 1 exiting: rc = 0 00000020:00000080:3.0:1787118813.275941:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96134556b800 for MGS 00000100:00100000:2.0:1787118813.276638:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff961350983c00:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1787118813.276686:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276696:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276715:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276952:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276958:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276964:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276970:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276975:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276982:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276988:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276993:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.276999:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277005:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277011:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277016:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277021:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277026:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277032:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277038:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277043:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277049:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277054:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277061:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277067:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277072:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277079:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277085:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277091:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277096:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277101:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277107:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277112:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277118:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277123:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277128:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277133:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277138:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277150:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277156:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277161:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277166:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277171:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277176:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277181:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277186:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277191:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277196:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277202:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277207:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277960:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277969:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277975:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277980:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277986:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277991:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.277996:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278002:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278007:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278012:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278017:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278025:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278031:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278036:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.278042:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787118813.278639:0:13036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787118813.278644:0:13036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787118813.279580:0:13036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff961350043540 - data ffff96137fcc2438/ffff961242956000 00000020:01000000:0.0:1787118813.279709:0:13036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff961358aaf060 - data ffff9613717cd798/ffff96134645cc00 00000020:00000080:0.0:1787118813.280636:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8239 00000020:00000080:0.0:1787118813.280643:0:13036:0:(genops.c:906:class_export_put()) final put ffff961344d04000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787118813.280655:0:13036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961347c3c800 from MGS, refs=2 00000020:01000004:0.0:1787118813.280665:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961347c3c800 2 00000020:01000004:0.0:1787118813.280669:0:13036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff961347c3c800 from MGS 00000020:00000080:0.0:1787118813.280689:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787118813.280695:0:13036:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787118813.280698:0:13036:0:(genops.c:906:class_export_put()) final put ffff961344d05800/MGS 00000020:00000080:0.0:1787118813.280701:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff961344d05800/MGS for MGS 00000020:01000000:0.0:1787118813.280707:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787118813.280789:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787118813.280792:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787118813.280797:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787118813.280803:0:13036:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff961375693000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787118813.280810:0:13036:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff961346513380) has exports, disconnecting them 00000020:00080000:0.0:1787118813.280814:0:13036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff961375693000), last request at 1787118568 00000020:00000080:0.0:1787118813.280818:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8304 00000020:00080000:0.0:1787118813.280824:0:13036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff961375693000): rc 0 00000020:00000080:0.0:1787118813.280828:0:13036:0:(genops.c:906:class_export_put()) final put ffff961375693000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787118813.281391:0:13036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787118813.281396:0:13036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787118813.281400:0:13036:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787118813.281405:0:13036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787118813.281492:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787118813.281497:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787118813.281500:0:13036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961347c3c800 1 00000020:00000080:0.0:1787118813.281504:0:13036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f822b 00000020:00000080:0.0:1787118813.281507:0:13036:0:(genops.c:906:class_export_put()) final put ffff961344d06000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787118813.281511:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787118813.281514:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787118813.281517:0:13036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787118813.281519:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9613496a4d40) has no exports 00000020:00000080:2.0:1787118813.285496:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961344d04000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787118813.285514:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961375693000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787118813.285540:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff961375694800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787118813.285551:0:36:0:(genops.c:906:class_export_put()) final put ffff9613756da800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787118813.285553:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9613756da800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787118813.285558:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787118813.285673:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961344d06000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787118813.305229:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787118813.305242:0:13036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787118813.305247:0:13036:0:(genops.c:906:class_export_put()) final put ffff961344c22800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787118813.305252:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff961344c22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787118813.305261:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787118813.305456:0:13036:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff961347435800 00000020:01000000:3.0:1787118813.305481:0:13036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787118813.305486:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787118813.305490:0:13036:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787118813.305494:0:13036:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff961346263380) has no exports 00000100:00100000:3.0:1787118813.305575:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96134969b000:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1787118813.308464:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96134969aa00:5843] 2 exiting: rc = 0 00000100:00100000:1.0:1787118813.312831:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff961349699000:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787118813.312844:0:7892:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff961241bcd200:7892] 3 exiting: rc = 0 00000100:00100000:3.0:1787118813.312973:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.312986:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.312995:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313003:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313015:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313024:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313031:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313048:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313059:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313066:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313071:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313077:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313083:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313088:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313094:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313101:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313109:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313116:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313124:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313131:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313137:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313145:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313153:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313159:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313166:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313174:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313184:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313191:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313200:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313210:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313230:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313236:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313248:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313257:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313290:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313300:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313307:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313318:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313323:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313334:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313341:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313347:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313352:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313358:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313364:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313370:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313376:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313382:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313387:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313392:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313397:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313402:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313408:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313413:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313418:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313423:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313429:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313435:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313440:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313445:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313451:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313456:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313462:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.313468:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.317998:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96134969a600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787118813.318189:0:12487:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff96137f86de00:12487] 2 exiting: rc = 0 00000100:00100000:2.0:1787118813.318409:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96134969b600:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1787118813.318522:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318530:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318536:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318543:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318556:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318561:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318568:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318573:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318579:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318585:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318590:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318597:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318603:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318608:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318614:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318619:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318624:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318629:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318635:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318640:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318646:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318651:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318657:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318662:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318667:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318673:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318679:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318684:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318689:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318694:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318699:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318705:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318710:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318715:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318812:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318820:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318826:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318831:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318837:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318848:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318853:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318859:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318864:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318869:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318875:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318881:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318886:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318891:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318897:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318902:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318907:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318913:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318918:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318923:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318928:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.318933:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319002:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319010:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319015:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319020:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319026:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319031:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319037:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.319049:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787118813.319608:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9613515d4000:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787118813.319764:0:12488:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9612422f0400:12488] 2 exiting: rc = 0 00000100:00100000:1.0:1787118813.326359:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9613515d5a00:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1787118813.326692:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.326702:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.328955:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.328969:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.328975:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.328981:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.328987:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329006:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329013:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329019:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329038:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329044:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329050:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329056:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329062:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329068:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329074:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329079:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329086:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329105:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329112:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329118:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329123:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329132:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329138:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329144:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329149:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329156:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329161:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329167:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329173:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329192:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329198:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329204:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329211:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329217:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329223:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329229:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329236:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329242:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329249:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329254:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329260:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329279:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329287:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329301:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329307:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329315:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329320:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329327:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329335:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329344:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329355:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329361:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329548:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329570:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329579:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329584:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329590:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329596:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329602:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329608:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329614:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.329629:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.339847:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff961342f01800:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1787118813.340151:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff961342f00400:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1787118813.340381:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340389:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340395:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340400:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340405:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340412:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340417:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340422:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340427:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340433:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340438:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340444:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340452:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340459:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340466:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340472:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340479:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340485:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340491:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340497:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340504:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340510:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340516:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340524:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340532:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340539:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340545:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340552:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340559:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340566:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340572:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340580:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340587:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340612:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340621:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340628:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340635:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340640:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340646:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340652:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340660:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340669:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340675:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340682:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340688:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340694:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340699:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340705:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340710:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.340715:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342184:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342205:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342360:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342368:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342373:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342378:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342383:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342388:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342394:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342399:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342404:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342409:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342415:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.342420:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787118813.343168:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff961342f00e00:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1787118813.344141:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff961342f01200:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787118813.344378:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344386:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344392:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344398:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344422:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344428:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344434:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344440:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344446:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344452:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344459:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344465:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344472:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344479:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344485:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344491:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344496:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344502:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344508:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344513:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344519:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344524:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344530:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344536:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344542:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344547:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344553:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344559:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344565:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344571:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344577:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344583:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344588:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344593:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344599:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344604:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344609:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344615:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344620:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344633:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344639:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344645:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344650:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344655:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344661:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344667:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344673:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344678:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344683:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344689:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344695:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344700:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344705:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344711:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344716:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344788:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344795:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344800:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344805:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344811:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344817:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344822:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344827:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.344833:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787118813.345486:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff961342f00a00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1787118813.345583:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff961342f00800:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1787118813.345685:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345691:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345697:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345703:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345708:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345714:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345719:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345813:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345818:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345823:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345839:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345844:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345849:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345855:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345860:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345866:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345871:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345876:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345881:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345886:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345892:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345897:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345902:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345907:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345913:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345918:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345923:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345928:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.345933:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346008:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346015:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346021:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346026:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346031:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346037:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346042:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346047:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346052:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346057:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346063:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346068:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346073:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346078:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346085:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346090:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346343:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346349:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346355:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346360:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346365:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346371:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346376:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346381:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346386:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346391:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346396:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346402:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346407:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346413:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346418:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346424:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346429:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346435:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.346441:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118813.347105:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9613515d5400:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1787118813.347476:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff961342f00000:5856] 2 exiting: rc = 0 00000100:00100000:2.0:1787118813.347694:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff961342f01600:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1787118813.347855:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347861:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347867:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347873:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347879:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347885:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347891:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347897:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347902:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347908:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347915:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347928:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.347935:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348006:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348012:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348030:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348035:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348040:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348045:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348052:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348057:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348063:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348069:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348074:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348080:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348086:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348095:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348102:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348107:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348113:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348119:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348125:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348131:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348136:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348141:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348161:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348168:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348173:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348180:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348187:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348193:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348199:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348205:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348211:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348217:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348343:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348348:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348354:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348361:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348366:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348379:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348385:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348390:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348397:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348403:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348408:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348414:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348420:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348426:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348432:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348438:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348444:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348449:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118813.348463:0:13036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787118813.353666:0:13036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787118813.353679:0:13036:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787118813.353685:0:13036:0:(genops.c:906:class_export_put()) final put ffff961346549800/MDS_uuid 00000020:00000080:0.0:1787118813.353689:0:13036:0:(genops.c:865:class_export_destroy()) destroying export ffff961346549800/MDS_uuid for MDS 00000020:01000000:0.0:1787118813.353695:0:13036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787118813.353918:0:13036:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787118813.963121:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787118814.117204:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787118814.117213:0:7647:0:(genops.c:906:class_export_put()) final put ffff96137a3d3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787118814.117249:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96137a3d3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787118814.117292:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137a3d4800 for lustre-OST0001 00010000:00010000:0.0:1787118814.986079:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118816.010027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787118816.319499:0:13190:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787118816.353897:0:13190:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787118816.353951:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.353966:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.353975:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.353996:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.354017:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787118816.354024:0:13190:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787118816.354048:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787118816.354053:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787118816.354058:0:13190:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787118816.354064:0:13190:0:(import.c:65:import_set_state_nolock()) ffff96137f88f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787118816.354068:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787118816.354070:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787118816.354073:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787118816.355180:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355194:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355201:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355208:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355225:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787118816.355231:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355252:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355258:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355265:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118816.355275:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787118816.355279:0:13190:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787118816.355295:0:13190:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787118816.355299:0:13190:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787118816.355303:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787118816.355308:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787118816.355311:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff961346510000) has no exports 00000020:00080000:1.0:1787118816.355334:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff961346510000) has no exports 00010000:00010000:2.0:1787118816.357480:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787118816.357492:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357502:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8da00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118816.357507:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357516:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118816.357524:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118816.357530:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787118816.357533:0:8464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787118816.357535:0:8464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787118816.357573:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357581:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118816.357616:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357623:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8da00/0xaa534e3c784f856c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8573 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357647:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787118816.357650:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357655:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118816.357657:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357663:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118816.357670:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118816.357675:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787118816.357677:0:8464:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787118816.357679:0:8464:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787118816.357692:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357698:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118816.357704:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357710:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8d000/0xaa534e3c784f857a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f8581 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357718:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118816.357751:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357763:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118816.357766:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357772:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118816.357778:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118816.357783:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787118816.357784:0:8464:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787118816.357786:0:8464:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787118816.357800:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357805:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118816.357821:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357827:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f87aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa534e3c784f87b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118816.357836:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118816.357838:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118816.357840:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118816.357866:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566249216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118816.357929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118816.357987:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787118816.358001:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566249088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118816.358024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118816.358050:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566249344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118816.358071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118816.358104:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249216 00000100:00100000:2.0:1787118816.358111:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249216 00000100:00100000:2.0:1787118816.358139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249088 00000100:00100000:2.0:1787118816.358141:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249088 00000100:00100000:2.0:1787118816.358148:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249344 00000100:00100000:2.0:1787118816.358150:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249344 00000100:00100000:2.0:1787118816.358161:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787118816.358167:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1873929566249216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787118816.358173:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787118816 with bad export cookie 12273239431138214485 00010000:00010000:0.0:1787118816.360119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118816.360130:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118816.360331:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787118816.360339:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3299:x1873929566249088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787118816.360346:0:8463:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787118816 with bad export cookie 12273239431138214485 00000100:00100000:0.0:1787118816.360424:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3299:x1873929566249088:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (2399us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787118816.360431:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787118816.360453:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787118816.360458:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3300:x1873929566249344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787118816.360462:0:8463:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787118816 with bad export cookie 12273239431138214485 00000100:00100000:0.0:1787118816.360509:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3300:x1873929566249344:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (2437us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787118816.360515:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787118816.360583:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787118816.360588:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96134654a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787118816.360592:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787118816.361791:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:1.0:1787118816.366064:0:13190:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9612420f5180 - data ffff961371038870/ffff96136e989800 00000020:01000000:1.0:1787118816.366210:0:13190:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96136e93bf00 - data ffff9613712b5d80/ffff961241371800 00000100:00100000:2.0:1787118816.376576:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3299:x1873929566249216:12345-0@lo:103:ldlm_bl.0 Request processed in 18403us (18642us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787118816.376589:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787118816.397418:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.110@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787118816.397423:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787118816.397433:0:3299:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff96137a748e00 x1873929566249216/t0(0) o103->MGC192.168.203.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787118832 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118816.397448:0:3299:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff96137a749c00 x1873929566249088/t0(0) o103->MGC192.168.203.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787118832 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118816.397456:0:3299:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff96137a74b800 x1873929566249344/t0(0) o103->MGC192.168.203.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787118832 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787118816.397503:0:3300:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96134654a000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1787118816.397987:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787118816.397991:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787118816.397993:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787118816.397996:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96134654a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118816.398001:0:3299:0:(import.c:510:import_select_connection()) MGC192.168.203.110@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:0.0:1787118816.398012:0:3299:0:(import.c:624:import_select_connection()) MGC192.168.203.110@tcp: import ffff96134654a000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118816.398137:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3300:1873929566249344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118816.398331:0:3299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a74b800 x1873929566249472/t0(0) o250->MGC192.168.203.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787118816.398381:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3297:1873929566249472:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787118816.398431:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873929566249472 offset 0 length 520: 4 00000100:00100000:2.0:1787118816.398502:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566249216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118816.398516:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3299:1873929566249088:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1787118816.406526:0:13190:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787118816.439321:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8389 00000020:00000080:3.0:1787118816.439331:0:13190:0:(genops.c:906:class_export_put()) final put ffff96137f88a000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787118816.439355:0:13190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961375697800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787118816.439358:0:13190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961375697800 2 00000020:01000004:3.0:1787118816.439362:0:13190:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff961375697800 from lustre-OST0000 00000020:00000080:3.0:1787118816.439381:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787118816.439390:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787118816.439407:0:13190:0:(genops.c:906:class_export_put()) final put ffff96137f88d800/lustre-OST0000_UUID 00000020:00000080:3.0:1787118816.439410:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f88d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787118816.439419:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787118816.439464:0:13190:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787118816.439469:0:13190:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787118816.439472:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787118816.439477:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787118816.439482:0:13190:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96137b487000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787118816.439488:0:13190:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9613465119c0) has exports, disconnecting them 00000020:00080000:3.0:1787118816.439493:0:13190:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96137b487000), last request at 1787118586 00000020:00000080:3.0:1787118816.439497:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f83b3 00000020:00080000:3.0:1787118816.439505:0:13190:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96137b487000): rc 0 00000020:00000080:3.0:1787118816.439510:0:13190:0:(genops.c:906:class_export_put()) final put ffff96137b487000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787118816.439940:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f88a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787118816.439948:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137b487000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787118816.456801:0:13190:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787118816.456811:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787118816.456816:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787118816.456840:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787118816.456952:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96137f88f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787118816.457122:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787118816.457130:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787118816.457134:0:13190:0:(genops.c:906:class_export_put()) final put ffff96137f88c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787118816.457138:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff96137f88c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787118816.457148:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787118816.457213:0:13190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961375697800 1 00000020:00000080:1.0:1787118816.457217:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8343 00000020:00000080:1.0:1787118816.457221:0:13190:0:(genops.c:906:class_export_put()) final put ffff961375696000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787118816.457232:0:13190:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787118816.457237:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787118816.457240:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787118816.457244:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff961343f03380) has no exports 00000020:00000080:2.0:1787118816.457363:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961375696000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787118816.482779:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787118816.482805:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787118816.482810:0:13190:0:(genops.c:906:class_export_put()) final put ffff961375690800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787118816.482827:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff961375690800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787118816.482839:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787118816.482974:0:13190:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff961375693800 00000020:02000400:2.0:1787118816.483020:0:13190:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787118817.033828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787118817.101072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5ef2904-bcdb-440a-9dd6-e4ff5e107e82->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787118817.101082:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5ef2904-bcdb-440a-9dd6-e4ff5e107e82->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787118817.101085:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787118817.101088:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787118817.101093:0:36:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787118817.101101:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 391 00000100:00080000:1.0:1787118817.101106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787118817.101112:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9613501ce000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:1.0:1787118817.101148:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961375ccf800 x1873929566249600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787118817.101184:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566249600:0@lo:38:kworker.0 00000400:00000100:1.0:1787118817.101242:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873929566249600 offset 0 length 520: 4 00010000:00010000:2.0:1787118818.058679:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118819.083653:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787118819.487251:0:13339:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787118819.512367:0:13339:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787118819.512441:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.512457:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.512464:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.512471:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.512546:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787118819.512551:0:13339:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787118819.512589:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787118819.512600:0:13339:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff961375ccf800 x1873929566249600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787118832 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118819.512626:0:13339:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787118819.512632:0:13339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787118819.512638:0:13339:0:(import.c:65:import_set_state_nolock()) ffff9613501ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787118819.512643:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787118819.512647:0:13339:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff961375ccf800 x1873929566249600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787118832 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118819.512653:0:13339:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787118819.512656:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1787118819.512874:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566249600:0@lo:38:kworker.0 00010000:00010000:3.0:1787118819.515163:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.515181:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.515189:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.515196:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118819.515267:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787118819.515275:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118819.515284:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174800 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118819.515289:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118819.515320:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118819.515328:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118819.515334:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787118819.515337:0:8462:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787118819.515339:0:8462:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787118819.515353:0:8462:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96134654a000 00010000:00010000:0.0:1787118819.515357:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118819.515363:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174800/0xaa534e3c784f8550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f8557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.515925:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118819.515932:0:8462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.515958:0:8462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382174a00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118819.515961:0:8462:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.515967:0:8462:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118819.515973:0:8462:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118819.515978:0:8462:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787118819.515980:0:8462:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787118819.515986:0:8462:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96134654a000 00010000:00010000:1.0:1787118819.515989:0:8462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.515997:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118819.515999:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118819.516001:0:8462:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118819.517872:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118819.517885:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174a00/0xaa534e3c784f855e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f8565 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.517909:0:13339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.517938:0:13339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.517956:0:13339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118819.517963:0:13339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.519242:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118819.519254:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.519264:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ca00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:1.0:1787118819.519268:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.519277:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118819.519300:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118819.519305:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787118819.519308:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787118819.519319:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96134654a000 00010000:00010000:1.0:1787118819.519323:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.519334:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118819.519336:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118819.519337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118819.519449:0:13339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118819.519454:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f8795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f879c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118819.519470:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787118819.519475:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787118819.519478:0:13339:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787118819.519507:0:13339:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787118819.519517:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787118819.519523:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787118819.519528:0:13339:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787118819.519532:0:13339:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff96137abc99c0) has no exports 00000020:00080000:3.0:1787118819.519555:0:13339:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff96137abc99c0) has no exports 00010000:00010000:2.0:1787118819.525022:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787118819.525188:0:13339:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9612420f5720 - data ffff9613717f7af8/ffff96137a081800 00000020:01000000:3.0:1787118819.525316:0:13339:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff961350043360 - data ffff9613711bb288/ffff96137f642400 00100000:10000000:2.0:1787118819.546374:0:13339:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787118819.579810:0:13339:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8454 00000020:00000080:1.0:1787118819.579820:0:13339:0:(genops.c:906:class_export_put()) final put ffff96137a3d5000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787118819.579832:0:13339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96137a707800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787118819.579835:0:13339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96137a707800 2 00000020:01000004:1.0:1787118819.579837:0:13339:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96137a707800 from lustre-OST0001 00000020:00000080:1.0:1787118819.579865:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787118819.579874:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787118819.579876:0:13339:0:(genops.c:906:class_export_put()) final put ffff96137a3d1000/lustre-OST0001_UUID 00000020:00000080:1.0:1787118819.579879:0:13339:0:(genops.c:865:class_export_destroy()) destroying export ffff96137a3d1000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787118819.579886:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787118819.580106:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96137a3d5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787118819.580379:0:13339:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f5ef2904-bcdb-440a-9dd6-e4ff5e107e82->MGS 00010000:00010000:1.0:1787118819.580393:0:13339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118819.580404:0:13339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118819.580410:0:13339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787118819.580422:0:13339:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787118819.580426:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787118819.580437:0:13339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96134654a000 00010000:00010000:1.0:1787118819.580441:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff9613414b0400/0xaa534e3c784f8366 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f836d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118819.580456:0:13339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787118819.580463:0:13339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118819.580468:0:13339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787118819.580471:0:13339:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787118819.580472:0:13339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787118819.580486:0:13339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96134654a000 00010000:00010000:1.0:1787118819.580489:0:13339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff961382174000/0xaa534e3c784f85a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa534e3c784f85ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787118819.580504:0:13339:0:(import.c:65:import_set_state_nolock()) ffff96134654a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787118819.580507:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787118819.580509:0:13339:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787118819.580511:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787118819.580515:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787118819.580525:0:13339:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff96137a74b800 x1873929566249472/t0(0) o250->MGC192.168.203.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787118826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787118819.580545:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787118819.580548:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787118819.580624:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5ef2904-bcdb-440a-9dd6-e4ff5e107e82:3297:1873929566249472:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1787118819.580681:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787118819.580688:0:13339:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8247 00000020:00000080:1.0:1787118819.580692:0:13339:0:(genops.c:906:class_export_put()) final put ffff96134654f800/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 00000020:01000000:1.0:1787118819.580779:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.110@tcp (flags='') 00000020:00000080:1.0:1787118819.580789:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787118819.580794:0:13339:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787118819.580798:0:13339:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff961346264d40) has no exports 00000020:00000080:0.0:1787118819.581602:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96134654f800/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 for MGC192.168.203.110@tcp 10000000:01000000:3.0:1787118819.581635:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787118819.581904:0:13339:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.110@tcp: client import never connected 00000100:00080000:1.0:1787118819.581908:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787118819.581910:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787118819.581913:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787118819.581916:0:13339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787118819.581955:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787118819.581962:0:13339:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.110@tcp (uuid f5ef2904-bcdb-440a-9dd6-e4ff5e107e82) 00000020:01000000:1.0:1787118819.581968:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787118819.581972:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787118819.581976:0:13339:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787118819.581981:0:13339:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff961243398000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787118819.581987:0:13339:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9613496a3380) has exports, disconnecting them 00000020:00080000:1.0:1787118819.581992:0:13339:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff961243398000), last request at 1787118606 00000020:00000080:0.0:1787118819.581994:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96134654a000 for MGC192.168.203.110@tcp 00000020:00000080:1.0:1787118819.581998:0:13339:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f847e 00000020:00000080:0.0:1787118819.582003:0:36:0:(genops.c:906:class_export_put()) final put ffff961346548800/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 00000020:00000080:0.0:1787118819.582006:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961346548800/f5ef2904-bcdb-440a-9dd6-e4ff5e107e82 for MGC192.168.203.110@tcp 00000020:01000000:0.0:1787118819.582012:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.110@tcp (f5ef2904-bcdb-440a-9dd6-e4ff5e107e82) 00000020:00080000:1.0:1787118819.582015:0:13339:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff961243398000): rc 0 00000020:00000080:1.0:1787118819.582020:0:13339:0:(genops.c:906:class_export_put()) final put ffff961243398000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787118819.582570:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff961243398000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787118819.584873:0:13339:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787118819.584882:0:13339:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787118819.584887:0:13339:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787118819.584893:0:13339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787118819.584976:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787118819.585256:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9613501ce000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787118819.586794:0:8462:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787118819.586963:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787118819.587139:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787118819.587345:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9613600c7e00:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787118819.587471:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9613600c7200:5825] 1 exiting: rc = 0 00000100:00100000:3.0:1787118819.587540:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.588013:0:8463:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96137f73b200:8463] 3 exiting: rc = 0 00000100:00100000:0.0:1787118819.588087:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96134642e000:5828] 2 exiting: rc = 0 00000100:00100000:0.0:1787118819.588136:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9613600c6600:5826] 0 exiting: rc = 1 00000100:00100000:2.0:1787118819.590304:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96134642f600:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1787118819.590525:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590532:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590538:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590544:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590549:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590554:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590559:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590564:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590569:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590574:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590582:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590587:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590592:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590597:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590604:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590610:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590616:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590620:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590625:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590630:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590635:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590640:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590645:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590650:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590657:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590663:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590668:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590673:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590678:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590683:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590689:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590698:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590703:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590716:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590758:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590764:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590769:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590774:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590779:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590785:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590790:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590795:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590799:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590803:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590808:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590812:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590817:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590822:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590827:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590832:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590837:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590842:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590847:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590853:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590858:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590862:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590867:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590871:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590876:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590881:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590886:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590891:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590897:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.590902:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787118819.594506:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787118819.594518:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787118819.594524:0:13339:0:(genops.c:906:class_export_put()) final put ffff9613500c0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787118819.594529:0:13339:0:(genops.c:865:class_export_destroy()) destroying export ffff9613500c0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787118819.594534:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787118819.594594:0:13339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96137a707800 1 00000020:00000080:3.0:1787118819.594600:0:13339:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xaa534e3c784f8423 00000020:00000080:3.0:1787118819.594606:0:13339:0:(genops.c:906:class_export_put()) final put ffff96136eb50800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787118819.594628:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787118819.594633:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787118819.594638:0:13339:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787118819.594641:0:13339:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff96137a6b4d40) has no exports 00000020:00000080:0.0:1787118819.594766:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb50800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787118819.631897:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787118819.631912:0:13339:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787118819.631917:0:13339:0:(genops.c:906:class_export_put()) final put ffff96136eb56000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787118819.631922:0:13339:0:(genops.c:865:class_export_destroy()) destroying export ffff96136eb56000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787118819.631934:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787118819.632200:0:13339:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96137a702000 00000020:01000000:3.0:1787118819.632224:0:13339:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787118819.632229:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787118819.632234:0:13339:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787118819.632238:0:13339:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff961343f00000) has no exports 00000020:00000080:3.0:1787118819.632285:0:13339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787118819.632294:0:13339:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787118819.632297:0:13339:0:(genops.c:906:class_export_put()) final put ffff961375695800/OSS_uuid 00000020:00000080:3.0:1787118819.632299:0:13339:0:(genops.c:865:class_export_destroy()) destroying export ffff961375695800/OSS_uuid for OSS 00000020:01000000:3.0:1787118819.632302:0:13339:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787118819.632328:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787118819.632481:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96137f6db200:8419] 3 exiting: rc = 0 00000100:00100000:2.0:1787118819.635424:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9613600d2800:6703] 0 exiting: rc = 1 00000100:00100000:2.0:1787118819.635516:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96134642e600:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1787118819.636782:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96134769f000:6705] 2 exiting: rc = 0 00000100:00100000:3.0:1787118819.639756:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639767:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639778:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639785:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639791:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639797:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639825:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639832:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639837:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639841:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639857:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639862:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639866:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639871:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639875:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639880:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639885:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639890:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639895:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639899:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639905:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639910:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639918:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639926:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639931:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639936:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639941:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639946:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639951:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639956:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639960:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639965:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639970:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639976:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639981:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639987:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639992:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.639999:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640006:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640011:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640019:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640024:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640032:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640040:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640046:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640060:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640071:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640078:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640084:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640089:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640095:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640103:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640112:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640122:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640132:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640143:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640152:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640164:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640171:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640176:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640181:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640187:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640192:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.640197:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641623:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96136e833600:6707] 1 exiting: rc = 0 00000100:00100000:1.0:1787118819.641646:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9613654b7400:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1787118819.641746:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641759:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641766:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641773:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641780:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641787:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641794:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641800:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641805:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641810:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641815:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641821:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641827:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641836:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641841:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641860:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641866:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641871:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641876:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641881:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641886:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641890:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641896:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641901:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641905:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641910:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641914:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641920:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641926:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641930:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641935:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641941:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641947:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641954:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641962:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641970:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641979:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641984:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641988:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641993:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.641997:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642003:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642008:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642013:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642018:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642023:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642028:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642033:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642038:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642043:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642056:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642061:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642068:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642073:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642079:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642084:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642090:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642095:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642099:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642105:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642110:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642114:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642119:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642123:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.642979:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96134769e200:6710] 2 exiting: rc = 0 00000100:00100000:1.0:1787118819.643203:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96136e832c00:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1787118819.643362:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96136e833c00:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1787118819.643791:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.643799:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.643805:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644019:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644026:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644031:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644037:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644043:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644049:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644055:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644061:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644066:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644071:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644077:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644348:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644358:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644366:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644376:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644402:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644410:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644424:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644430:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644435:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644441:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644446:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644452:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644459:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644464:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644470:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644475:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644481:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644486:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644491:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644496:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644502:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644507:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644513:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644518:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644524:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644529:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644535:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644541:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644564:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644574:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644580:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644586:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644591:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644602:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644607:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644613:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644618:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644623:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644629:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644635:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644642:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644659:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644669:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644674:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644684:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644691:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644697:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644703:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644744:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787118819.644760:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787118819.656836:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96134652a400:6711] 0 exiting: rc = 1 00000100:00100000:1.0:1787118819.656917:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96136e837a00:6712] 1 exiting: rc = 0 00000100:00100000:0.0:1787118819.657015:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657023:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657028:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657043:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657049:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657054:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657060:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657066:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657071:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657076:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657081:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657087:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657092:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657096:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657101:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657107:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657111:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657116:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657121:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657126:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657131:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657135:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657140:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657158:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657163:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657168:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657289:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657294:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657299:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657304:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657310:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657314:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657319:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657323:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657328:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657333:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657337:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657342:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657349:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657354:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657359:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657364:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657369:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657374:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657379:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657383:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657388:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657393:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657398:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657403:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657411:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657417:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657421:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657426:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657431:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657435:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657440:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657444:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657457:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657462:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657467:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657474:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657479:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.657484:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787118819.659313:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9613477d9c00:6713] 0 exiting: rc = 1 00000100:00100000:2.0:1787118819.659887:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff961350e04200:6714] 1 exiting: rc = 0 00000100:00100000:0.0:1787118819.660296:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660313:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660332:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660338:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660345:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660351:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660357:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660366:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660372:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660378:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660385:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660391:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660397:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660413:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660436:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660444:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660449:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660458:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660463:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660469:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660474:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660480:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660488:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660493:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660499:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660505:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660526:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660533:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660539:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660557:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660562:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660568:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660574:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660579:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660585:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660590:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660595:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660603:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660621:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660627:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660632:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660637:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660642:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660648:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660653:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660659:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660665:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660672:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660678:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660685:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660713:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660833:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660842:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660849:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660854:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660870:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660877:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660882:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660887:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660893:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660898:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.660904:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.661032:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787118819.661105:0:13339:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787118819.676498:0:13339:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787118843.167781:0:13957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787118853.121242:0:14418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787118853.121248:0:14418:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787118853.121360:0:14418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96137863b800 00000020:01000004:1.0:1787118853.121377:0:14418:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787118853.121385:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787118853.121411:0:14418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96137abc99c0) 00000020:00000080:1.0:1787118853.121437:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787118853.148046:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787118853.160305:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787118853.160680:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 411: rc = 0 00100000:10000000:1.0:1787118853.160804:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 411: rc = 0 00100000:10000000:1.0:1787118853.160916:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 411: rc = 0 00100000:10000000:1.0:1787118853.161015:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 411: rc = 0 00100000:10000000:1.0:1787118853.161199:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787118853.161268:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 411: rc = 0 00100000:10000000:1.0:1787118853.161369:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 411: rc = 0 00100000:10000000:1.0:1787118853.162782:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 413: rc = 0 00100000:10000000:1.0:1787118853.169118:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 551: rc = 0 00100000:10000000:1.0:1787118853.169230:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 551: rc = 0 00100000:10000000:1.0:1787118853.169699:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:1.0:1787118853.170705:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.171520:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.171808:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:1.0:1787118853.172233:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.173998:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:1.0:1787118853.174294:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:1.0:1787118853.177979:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.178270:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.178551:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:1.0:1787118853.178840:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:1.0:1787118853.179084:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:1.0:1787118853.183987:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 369: rc = 0 00100000:10000000:1.0:1787118853.184406:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 369: rc = 0 00100000:10000000:0.0:1787118853.187016:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 369: rc = 0 00100000:10000000:0.0:1787118853.187283:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 369: rc = 0 00100000:10000000:0.0:1787118853.188230:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 369: rc = 0 00100000:10000000:0.0:1787118853.189181:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 369: rc = 0 00100000:10000000:0.0:1787118853.190801:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 369: rc = 0 00100000:10000000:0.0:1787118853.192198:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 369: rc = 0 00100000:10000000:0.0:1787118853.192520:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 369: rc = 0 00100000:10000000:0.0:1787118853.193092:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 369: rc = 0 00100000:10000000:0.0:1787118853.193410:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 369: rc = 0 00100000:10000000:0.0:1787118853.194279:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 369: rc = 0 00100000:10000000:0.0:1787118853.198275:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 369: rc = 0 00100000:10000000:0.0:1787118853.198860:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 369: rc = 0 00100000:10000000:0.0:1787118853.199274:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 369: rc = 0 00100000:10000000:0.0:1787118853.201165:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 369: rc = 0 00100000:10000000:0.0:1787118853.205658:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 369: rc = 0 00100000:10000000:0.0:1787118853.208088:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 369: rc = 0 00100000:10000000:0.0:1787118853.208399:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 369: rc = 0 00100000:10000000:0.0:1787118853.209286:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 369: rc = 0 00100000:10000000:0.0:1787118853.209684:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 369: rc = 0 00100000:10000000:0.0:1787118853.210097:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 369: rc = 0 00100000:10000000:0.0:1787118853.214788:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 369: rc = 0 00100000:10000000:0.0:1787118853.215172:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 369: rc = 0 00100000:10000000:0.0:1787118853.215446:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 369: rc = 0 00100000:10000000:0.0:1787118853.216047:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 369: rc = 0 00100000:10000000:0.0:1787118853.216292:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 369: rc = 0 00100000:10000000:0.0:1787118853.216561:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 369: rc = 0 00100000:10000000:0.0:1787118853.216838:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 369: rc = 0 00100000:10000000:0.0:1787118853.217103:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 369: rc = 0 00100000:10000000:0.0:1787118853.217338:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 369: rc = 0 00100000:10000000:0.0:1787118853.217607:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 369: rc = 0 00100000:10000000:0.0:1787118853.217988:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 658: rc = 0 00100000:10000000:0.0:1787118853.218457:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787118853.218646:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 552: rc = 0 00100000:10000000:0.0:1787118853.218875:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787118853.218943:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 552: rc = 0 00100000:10000000:0.0:1787118853.219123:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787118853.219184:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 552: rc = 0 00100000:10000000:3.0:1787118853.225304:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787118853.225556:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 356: rc = 0 00100000:10000000:3.0:1787118853.225818:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787118853.226533:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 356: rc = 0 00100000:10000000:3.0:1787118853.226779:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787118853.226854:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 356: rc = 0 00000020:00000080:3.0:1787118853.227185:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787118853.227192:0:14418:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787118853.227202:0:14418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f9548 00000020:01000004:3.0:1787118853.227210:0:14418:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787118853.227215:0:14418:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787118853.227220:0:14418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96137863b800 from MGS 00000020:01000004:3.0:1787118853.227223:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787118853.227232:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96137a6b4d40) 00000020:00000080:3.0:1787118853.227241:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787118853.227293:0:14418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137863b800 from MGS, refs=2 00080000:01000000:3.0:1787118853.227297:0:14418:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787118853.227300:0:14418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f9556 00000100:00100000:3.0:1787118853.227397:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787118853.227596:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787118853.227602:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787118853.228170:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787118853.228178:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787118853.229139:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.229294:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787118853.229308:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787118853.230069:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787118853.230076:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787118853.230320:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787118853.230326:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787118853.230952:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118853.230955:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118853.230957:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118853.231248:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118853.231251:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118853.231253:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118853.239581:0:14418:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787118853.245009:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787118853.269954:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787118853.269972:0:14418:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787118853.269975:0:14418:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787118853.272043:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787118853.272171:0:14418:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787118853.272266:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787118853.272780:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787118853.273827:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.274010:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787118853.274017:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787118853.275075:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787118853.275084:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787118853.275446:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787118853.275453:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787118853.276661:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787118853.276683:0:14418:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.110@tcp' 00000020:01000004:3.0:1787118853.276700:0:14418:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787118853.276762:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.110@tcp (typ=mgc) 00000020:00000080:3.0:1787118853.276774:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.110@tcp (ffff96137a6b3380) 00000020:00000080:3.0:1787118853.276790:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787118853.276859:0:14418:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96137a804000@MGC192.168.203.110@tcp: add connection 192.168.203.110@tcp at head 00010000:00010000:3.0:1787118853.277028:0:14418:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.110@tcp-0 is initialized 00000040:01000000:3.0:1787118853.277034:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787118853.277208:0:14431:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787118853.291513:0:14433:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787118853.291562:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.110@tcp (uuid a15e2bd8-d402-42e4-a923-f01b19147eee) 00000020:00000080:3.0:1787118853.291584:0:14418:0:(genops.c:1406:class_connect()) connect: client a15e2bd8-d402-42e4-a923-f01b19147eee, cookie 0xaa534e3c784f9564 00000100:00080000:3.0:1787118853.291596:0:14418:0:(import.c:510:import_select_connection()) MGC192.168.203.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787118853.291603:0:14418:0:(import.c:624:import_select_connection()) MGC192.168.203.110@tcp: import ffff96137a804000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118853.291637:0:14418:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96124139a300 x1873929566249728/t0(0) o250->MGC192.168.203.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118853.291687:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a15e2bd8-d402-42e4-a923-f01b19147eee:3297:1873929566249728:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787118853.291767:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118853.291838:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249728 00000100:00100000:3.0:1787118853.291844:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249728 00000100:00100000:3.0:1787118853.291887:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118853.291893:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613515ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1873929566249728:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787118853.291915:0:14428:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from a15e2bd8-d402-42e4-a923-f01b19147eee@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1787118853.291937:0:14428:0:(genops.c:1406:class_connect()) connect: client a15e2bd8-d402-42e4-a923-f01b19147eee, cookie 0xaa534e3c784f956b 00000100:00080000:3.0:1787118853.292057:0:14428:0:(import.c:65:import_set_state_nolock()) ffff96134871f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118853.292109:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613515ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+5:3297:x1873929566249728:12345-0@lo:250:mount.lustre.0 Request processed in 214us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.292117:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787118853.292158:0:3297:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787118853.292166:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.110@tcp: connect to target with instance 0 00000100:00080000:3.0:1787118853.292172:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787118853.292175:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787118853.292178:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96137a804000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787118853.292180:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787118853.292184:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787118853.292188:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a15e2bd8-d402-42e4-a923-f01b19147eee:3297:1873929566249728:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1787118853.292206:0:14418:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a15e2bd8-d402-42e4-a923-f01b19147eee->MGS 00000020:01000004:3.0:1787118853.292232:0:14418:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787118853.292237:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787118853.292251:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96137a6b0000) 00000020:00000080:3.0:1787118853.292261:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787118853.314317:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787118853.314919:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787118853.314925:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787118853.318979:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787118853.318995:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787118853.319330:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787118853.319338:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787118853.319997:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.320167:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787118853.320172:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787118853.320702:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787118853.320710:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787118853.358416:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.358695:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787118853.358702:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787118853.360048:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787118853.360057:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787118853.360565:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.360905:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787118853.360911:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787118853.361438:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787118853.361445:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787118853.362080:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.362221:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787118853.362226:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787118853.362790:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787118853.362797:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787118853.363304:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787118853.363446:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787118853.363451:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787118853.364180:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787118853.364186:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787118853.386289:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787118853.386651:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787118853.386660:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787118853.388006:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787118853.388016:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787118853.389029:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787118853.389038:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787118853.389879:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787118853.389901:0:14418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787118853.389906:0:14418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787118853.390035:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787118853.390067:0:14418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.110@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787118853.390072:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787118853.390073:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118853.390075:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118853.390076:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118853.390077:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118853.390079:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118853.390080:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118853.390081:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118853.390083:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118853.390085:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787118853.390092:0:14418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787118853.390094:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787118853.390095:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118853.390096:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118853.390097:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118853.390098:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118853.390099:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118853.390100:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118853.390101:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118853.390102:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118853.390103:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787118853.390127:0:14418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787118853.390146:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566249856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787118853.390216:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.390314:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503840 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.390405:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249856 00000100:00100000:1.0:1787118853.390413:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249856 00000100:00100000:1.0:1787118853.390498:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118853.390507:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+5:14418:x1873929566249856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787118853.390548:0:14430:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787118853.390550:0:14430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787118853.390554:0:14430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787118853.390948:0:14451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787118853.391322:0:14430:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787118853.392502:0:14452:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787118853.392508:0:14452:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787118853.392511:0:14452:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787118853.392548:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787118853.392823:0:14430:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787118853.392832:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787118853.408389:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+5:14418:x1873929566249856:12345-0@lo:253:mount.lustre.0 Request processed in 17874us (18163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.408404:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118853.408495:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566249856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787118853.408511:0:14418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787118853.408514:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787118853.408515:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787118853.408517:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787118853.408518:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787118853.408519:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787118853.408520:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787118853.408521:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787118853.408522:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787118853.408523:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787118853.408525:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787118853.408542:0:14418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96137863b800 from lustre-MDT0000 10000000:01000000:0.0:1787118853.408566:0:14418:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787118853.408569:0:14418:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787118853.408572:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96137a6b3380 10000000:01000000:0.0:1787118853.408587:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787118853.408594:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff96137a6b3380 from 1 10000000:01000000:0.0:1787118853.408596:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787118853.408694:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.408706:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.408715:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.408756:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566249984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.408789:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.408868:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118853.408902:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566249984 00000100:00100000:3.0:1787118853.408908:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566249984 00000100:00100000:3.0:1787118853.409172:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787118853.409182:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+5:14418:x1873929566249984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118853.409194:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118853.409210:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042000/0xaa534e3c784f9580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9579 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.409231:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042000/0xaa534e3c784f9580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9579 expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.409248:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042000/0xaa534e3c784f9580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9579 expref: 6 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.409256:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042000, rc 0) 00000100:00100000:3.0:1787118853.409299:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+6:14418:x1873929566249984:12345-0@lo:101:mount.lustre.0 Request processed in 119us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.409305:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118853.409363:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566249984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118853.409377:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.409386:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.409436:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118853.409461:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.409571:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.409824:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250112 00000100:00100000:1.0:1787118853.409830:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250112 00000100:00100000:1.0:1787118853.409853:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787118853.409859:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+6:14418:x1873929566250112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787118853.410222:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+6:14418:x1873929566250112:12345-0@lo:501:mount.lustre.0 Request processed in 362us (759us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118853.410230:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118853.410308:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250112:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787118853.410337:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787118853.410351:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.410366:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.410374:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96137863b800 10000000:01000000:0.0:1787118853.410378:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787118853.410382:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96137863b800 10000000:01000000:0.0:1787118853.410385:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787118853.410387:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff96137863b800 from 1 10000000:01000000:0.0:1787118853.410390:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787118853.410408:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.410415:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.410422:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.410436:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.410463:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.410504:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118853.410536:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250240 00000100:00100000:3.0:1787118853.410539:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250240 00000100:00100000:3.0:1787118853.410560:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787118853.410566:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+6:14418:x1873929566250240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118853.410573:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118853.410583:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382043200/0xaa534e3c784f958e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9587 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.410608:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382043200/0xaa534e3c784f958e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9587 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.410617:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382043200/0xaa534e3c784f958e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9587 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.410624:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382043200, rc 0) 00000100:00100000:3.0:1787118853.410659:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+7:14418:x1873929566250240:12345-0@lo:101:mount.lustre.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.410665:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787118853.410900:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118853.410910:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f958e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.410918:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f958e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.410940:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787118853.411059:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f958e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.411066:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81c00/0xaa534e3c784f9587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f958e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.411073:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787118853.411076:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787118853.411081:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96137863b800 10000000:01000000:0.0:1787118853.411083:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787118853.411086:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787118853.411090:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787118853.411104:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.411111:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.411118:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.411130:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.411156:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.411185:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503600 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.411244:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250368 00000100:00100000:1.0:1787118853.411249:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250368 00000100:00100000:1.0:1787118853.411280:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787118853.411288:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+7:14418:x1873929566250368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118853.411295:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118853.411306:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9800/0xaa534e3c784f959c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9595 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.411320:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9800/0xaa534e3c784f959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9595 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.411328:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9800/0xaa534e3c784f959c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9595 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.411336:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9800, rc 0) 00000100:00100000:1.0:1787118853.411367:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+8:14418:x1873929566250368:12345-0@lo:101:mount.lustre.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.411373:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118853.411440:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118853.411450:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f959c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.411465:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f959c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.411518:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118853.411544:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.411568:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961378503600 going to sleep for 11 seconds 00000100:00100000:0.0:1787118853.411588:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250496 00000100:00100000:0.0:1787118853.411591:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250496 00000100:00100000:0.0:1787118853.413108:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787118853.413121:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+8:14418:x1873929566250496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118853.413521:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14418:x1873929566250496:12345-0@lo:501:mount.lustre.0 Request processed in 403us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118853.413529:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787118853.413587:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118853.418107:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787118853.418201:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118853.418260:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787118853.418367:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250624 00000100:00100000:0.0:1787118853.418375:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250624 00000100:00100000:0.0:1787118853.418428:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787118853.418438:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14418:x1873929566250624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118853.418900:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14418:x1873929566250624:12345-0@lo:503:mount.lustre.0 Request processed in 461us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118853.418909:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787118853.419422:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566250624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118853.420211:0:14453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14453:1873929566250752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118853.420263:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.420329:0:14453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613785033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.420370:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566250752 00000100:00100000:1.0:1787118853.420376:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566250752 00000100:00100000:1.0:1787118853.420433:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787118853.420441:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14453:x1873929566250752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118853.420735:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14453:x1873929566250752:12345-0@lo:502:llog_process_th.0 Request processed in 279us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.420743:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787118853.420816:0:14453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14453:1873929566250752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118853.420839:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118853.420849:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.420851:0:14453:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787118853.420855:0:14453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787118853.420858:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787118853.420875:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff961343f03380) 00000020:00000080:2.0:1787118853.420893:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787118853.420898:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787118853.421064:0:14453:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787118853.421070:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f95aa 00000020:00000080:2.0:1787118853.421255:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787118853.421259:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118853.421262:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.421264:0:14453:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787118853.421266:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118853.421269:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.421271:0:14453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787118853.421274:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787118853.421280:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff961343f019c0) 00000020:00000080:2.0:1787118853.421288:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787118853.421291:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787118853.421292:0:14453:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787118853.421295:0:14453:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787118853.421300:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787118853.421331:0:14453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137863b800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787118853.421341:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff961343f04d40) 00000020:00000080:2.0:1787118853.421348:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787118853.421396:0:14453:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787118853.421401:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f95bf 00000020:00000080:2.0:1787118853.421491:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787118853.421497:0:14453:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787118853.421500:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa534e3c784f95c6 00080000:01000000:2.0:1787118853.421504:0:14453:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787118853.421507:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f95cd 00010000:00010000:1.0:1787118853.495381:0:14453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787118853.495906:0:14453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787118853.496147:0:14453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787118853.497205:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96137abcb380) 00000020:00000080:1.0:1787118853.497224:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787118853.497304:0:14453:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787118853.497311:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f95db 00000020:00000080:0.0:1787118853.504703:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787118853.511275:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa534e3c784f95e2 00000020:00000080:0.0:1787118853.513496:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787118853.513509:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118853.513516:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.513518:0:14453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787118853.513522:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118853.513527:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.513529:0:14453:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787118853.513532:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787118853.513570:0:14453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787118853.513584:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118853.513587:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.513588:0:14453:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787118853.513590:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787118853.513592:0:14453:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787118853.513593:0:14453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118853.513594:0:14453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118853.513596:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787118853.513607:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.513609:0:14453:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787118853.513611:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787118853.513614:0:14453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787118853.513618:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.513619:0:14453:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787118853.513622:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787118853.513627:0:14453:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.110@tcp to nid 0x20000c0a8cb6e (192.168.203.110@tcp) 00000020:01000000:0.0:1787118853.513649:0:14453:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787118853.513651:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787118853.513665:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9613496a0000) 00000020:00000080:0.0:1787118853.513679:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787118853.513683:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787118853.513744:0:14453:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787118853.513760:0:14453:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787118853.513767:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f95f0 00010000:00080000:0.0:1787118853.513794:0:14453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9613503a4800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:0.0:1787118853.514461:0:14453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787118853.519393:0:14453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787118853.519452:0:14453:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787118853.520927:0:14453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118853.521068:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787118853.521137:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787118853.522166:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787118853.522171:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787118853.522776:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787118853.522790:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787118853.522819:0:14453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787118853.522837:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f95f7 00000100:00080000:0.0:1787118853.522845:0:14453:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787118853.522850:0:14453:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9613503a4800 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118853.522884:0:14453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a765880 x1873929566250880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118853.522968:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566250880:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787118853.523017:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873929566250880 offset 0 length 520: 4 00000100:00080000:0.0:1787118853.523174:0:14453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787118853.523220:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118853.523224:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.523226:0:14453:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787118853.523228:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787118853.523231:0:14453:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787118853.523232:0:14453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118853.523233:0:14453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118853.523234:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787118853.523236:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.523238:0:14453:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787118853.523240:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787118853.523251:0:14453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787118853.523256:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118853.523257:0:14453:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787118853.523260:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787118853.523264:0:14453:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.110@tcp to nid 0x20000c0a8cb6e (192.168.203.110@tcp) 00000020:01000000:0.0:1787118853.523284:0:14453:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787118853.523287:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787118853.523298:0:14453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9613496a19c0) 00000020:00000080:0.0:1787118853.523312:0:14453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787118853.523316:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787118853.523382:0:14453:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787118853.523388:0:14453:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787118853.523394:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa534e3c784f9605 00010000:00080000:0.0:1787118853.523423:0:14453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9613500c3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:0.0:1787118853.523641:0:14453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787118853.523818:0:14453:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787118853.523836:0:14453:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787118853.530914:0:14453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118853.531110:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787118853.531186:0:14453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000020:00000080:3.0:1787118853.534577:0:14453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787118853.534592:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787118853.534636:0:14453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787118853.534655:0:14453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f960c 00000100:00080000:3.0:1787118853.534665:0:14453:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787118853.534671:0:14453:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9613500c3000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:3.0:1787118853.534704:0:14453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96124139a300 x1873929566251008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787118853.534752:0:14453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787118853.534798:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118853.534802:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118853.534804:0:14453:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787118853.534807:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118853.534811:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118853.534812:0:14453:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787118853.534815:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787118853.534817:0:14453:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787118853.534819:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118853.534820:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118853.534821:0:14453:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787118853.534823:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118853.534825:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118853.534825:0:14453:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787118853.534828:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787118853.534854:0:14453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14453:1873929566251136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118853.534930:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118853.535143:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566251008:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787118853.535174:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873929566251008 offset 0 length 520: 4 00000100:00100000:3.0:1787118853.535256:0:14453:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134966a300 going to sleep for 11 seconds 00000040:00080000:0.0:1787118853.535377:0:14459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787118853.535383:0:14459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787118853.535797:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251136 00000100:00100000:0.0:1787118853.535804:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251136 00000100:00100000:0.0:1787118853.535847:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787118853.535857:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14453:x1873929566251136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787118853.536174:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14453:x1873929566251136:12345-0@lo:502:llog_process_th.0 Request processed in 318us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118853.536182:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787118853.536273:0:14453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14453:1873929566251136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787118853.536301:0:14453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118853.536308:0:14453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118853.536309:0:14453:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787118853.536313:0:14453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787118853.536441:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787118853.536467:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787118853.536494:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f959c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.536504:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb80200/0xaa534e3c784f9595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f959c expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.536512:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96137863b800 from 1 10000000:01000000:0.0:1787118853.536515:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787118853.536543:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.536552:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.536561:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.536577:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.536919:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118853.537024:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251264 00000100:00100000:1.0:1787118853.537029:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251264 00000100:00100000:1.0:1787118853.537060:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787118853.537067:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+9:14418:x1873929566251264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118853.537076:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118853.537089:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9613 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.537111:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.537121:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.537129:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118853.537162:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+10:14418:x1873929566251264:12345-0@lo:101:mount.lustre.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.537168:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118853.537231:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118853.537249:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118853.537261:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.537269:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.538068:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251392:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787118853.538166:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.538301:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.540828:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251392 00000100:00100000:1.0:1787118853.540842:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251392 00000100:00100000:1.0:1787118853.541179:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118853.541192:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+10:14418:x1873929566251392:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787118853.541228:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787118853.541233:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787118853.541355:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+10:14418:x1873929566251392:12345-0@lo:256:mount.lustre.0 Request processed in 164us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.541363:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787118853.541446:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251392:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787118853.542092:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787118853.542115:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.542126:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.542135:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137863b800 from 1 10000000:01000000:0.0:1787118853.542138:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118853.542169:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.542177:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.542186:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.542205:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.542242:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118853.543101:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251520 00000100:00100000:3.0:1787118853.543110:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251520 00000100:00100000:2.0:1787118853.543255:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118853.543267:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+10:14418:x1873929566251520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787118853.543279:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118853.543309:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9621 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.543335:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.543347:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.543356:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118853.543400:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566251520:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.543407:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787118853.543503:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787118853.543524:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787118853.543538:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.543546:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118853.544075:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118853.544107:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.544167:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350750e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.544212:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251648 00000100:00100000:1.0:1787118853.544218:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251648 00000100:00100000:1.0:1787118853.544279:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787118853.544288:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566251648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787118853.545214:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566251648:12345-0@lo:501:mount.lustre.0 Request processed in 925us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.545224:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787118853.545318:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118853.545357:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118853.545397:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.545554:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350750e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787118853.545852:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251776 00000100:00100000:0.0:1787118853.545859:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251776 00000100:00100000:0.0:1787118853.545891:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787118853.545899:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566251776:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118853.546066:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566251776:12345-0@lo:503:mount.lustre.0 Request processed in 167us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118853.546077:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787118853.546216:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566251776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118853.547090:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14461:1873929566251904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118853.547137:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.547264:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350750840 going to sleep for 11 seconds 00000100:00100000:3.0:1787118853.547297:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566251904 00000100:00100000:3.0:1787118853.547302:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566251904 00000100:00100000:3.0:1787118853.547365:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787118853.547373:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14461:x1873929566251904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118853.547585:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14461:x1873929566251904:12345-0@lo:502:llog_process_th.0 Request processed in 212us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.547592:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787118853.547719:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14461:1873929566251904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787118853.547763:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118853.547772:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.547774:0:14461:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787118853.547780:0:14461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137863b800 00000020:00000080:2.0:1787118853.547783:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787118853.547789:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118853.547791:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.547792:0:14461:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787118853.547794:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118853.547796:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.547798:0:14461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787118853.547800:0:14461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137863b800 00000020:00000080:2.0:1787118853.547802:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787118853.547861:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787118853.547865:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.547866:0:14461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787118853.547868:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787118853.547871:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787118853.547872:0:14461:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787118853.547876:0:14461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96137863b800 00000020:00000080:2.0:1787118853.547878:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787118853.547912:0:14461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14461:1873929566252032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118853.547958:0:14461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118853.561470:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252032 00000100:00100000:3.0:1787118853.561495:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252032 00000100:00100000:3.0:1787118853.561535:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787118853.561545:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14461:x1873929566252032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787118853.561808:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14461:x1873929566252032:12345-0@lo:502:llog_process_th.0 Request processed in 264us (13848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.561816:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787118853.568822:0:14461:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.568865:0:14461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14461:1873929566252032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787118853.568907:0:14461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118853.568916:0:14461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118853.568919:0:14461:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787118853.568926:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787118853.569172:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787118853.569190:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118853.569213:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.569225:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118853.569268:0:14418:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787118853.569272:0:14418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96137863b800 10000000:01000000:0.0:1787118853.569275:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96137863b800 10000000:01000000:0.0:1787118853.569279:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787118853.569284:0:14418:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96137863b800 from 1 10000000:01000000:0.0:1787118853.569287:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787118853.569317:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.569326:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.569335:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.569355:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118853.569830:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.570852:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118853.571372:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252160 00000100:00100000:2.0:1787118853.571388:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252160 00000100:00100000:3.0:1787118853.572752:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787118853.572768:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566252160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118853.572785:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118853.572808:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382043400/0xaa534e3c784f9636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f962f expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.572836:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382043400/0xaa534e3c784f9636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f962f expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.572847:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382043400/0xaa534e3c784f9636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f962f expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.572855:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382043400, rc 0) 00000100:00100000:3.0:1787118853.572920:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252160:12345-0@lo:101:mount.lustre.0 Request processed in 158us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118853.572927:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787118853.573113:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118853.573132:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9636 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118853.573147:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9636 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118853.573213:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118853.573247:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.573283:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118853.573359:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252288 00000100:00100000:2.0:1787118853.573365:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252288 00000100:00100000:2.0:1787118853.573388:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787118853.573394:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118853.578290:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252288:12345-0@lo:501:mount.lustre.0 Request processed in 4888us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.578304:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787118853.578489:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118853.578537:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118853.578582:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118853.578625:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787118853.578825:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252416 00000100:00100000:0.0:1787118853.578832:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252416 00000100:00100000:0.0:1787118853.578866:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787118853.578873:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118853.579027:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252416:12345-0@lo:503:mount.lustre.0 Request processed in 153us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118853.579033:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787118853.579068:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118853.579822:0:14467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14467:1873929566252544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118853.579863:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.579893:0:14467:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.580028:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252544 00000100:00100000:1.0:1787118853.580033:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252544 00000100:00100000:1.0:1787118853.580059:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787118853.580065:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14467:x1873929566252544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787118853.580242:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14467:x1873929566252544:12345-0@lo:502:llog_process_th.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118853.580249:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787118853.580342:0:14467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14467:1873929566252544:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787118853.580397:0:14467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787118853.580411:0:14467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff961343f00000) 00000020:00000080:2.0:1787118853.580442:0:14467:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787118853.580772:0:14467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137863b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787118853.580778:0:14467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96137863b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787118853.580780:0:14467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96137863b800 4 00010000:00080000:2.0:1787118853.580809:0:14467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9613756da000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.110@tcp at head 00010000:00010000:2.0:1787118853.585150:0:14467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787118853.585266:0:14467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787118853.585300:0:14467:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787118853.585312:0:14467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa534e3c784f9644 00000100:00080000:2.0:1787118853.585321:0:14467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787118853.585327:0:14467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9613756da000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118853.585358:0:14467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a748e00 x1873929566252672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787118853.585414:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566252672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787118853.587059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.587134:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252672 00000100:00100000:2.0:1787118853.587141:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252672 00000100:00100000:2.0:1787118853.587180:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118853.587187:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1873929566252672:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787118853.587235:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1873929566252672:12345-0@lo:38:llog_process_th.0 Request processed in 47us (182us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787118853.587241:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118853.587272:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787118853.587279:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613756da000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787118853.587290:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787118853.587294:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566252672:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787118853.587318:0:14467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787118853.588924:0:14467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14467:1873929566252800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118853.588999:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.589029:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252800 00000100:00100000:2.0:1787118853.589034:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252800 00000100:00100000:2.0:1787118853.589065:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787118853.589072:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14467:x1873929566252800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787118853.589278:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14467:x1873929566252800:12345-0@lo:502:llog_process_th.0 Request processed in 205us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.589285:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787118853.589333:0:14467:0:(client.c:2702:ptlrpc_set_wait()) set ffff961347ca0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787118853.589352:0:14467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a15e2bd8-d402-42e4-a923-f01b19147eee:14467:1873929566252800:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787118853.589382:0:14467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787118853.591053:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787118853.591088:0:14418:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787118853.591106:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9636 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118853.591117:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb80a00/0xaa534e3c784f962f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9636 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787118853.591158:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787118853.591160:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787118853.591161:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787118853.591163:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787118853.591164:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787118853.591165:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787118853.591166:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787118853.591167:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787118853.591169:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787118853.591170:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787118853.591173:0:14418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787118853.591176:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787118853.591177:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787118853.591178:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787118853.591179:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787118853.591180:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787118853.591181:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787118853.591182:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787118853.591183:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787118853.591184:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787118853.591185:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787118853.591206:0:14418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787118853.591221:0:14418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787118853.591283:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118853.591308:0:14418:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cb000 going to sleep for 11 seconds 00000100:00100000:1.0:1787118853.591334:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566252928 00000100:00100000:1.0:1787118853.591340:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566252928 00000100:00100000:1.0:1787118853.591376:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787118853.591385:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14418:x1873929566252928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787118853.591414:0:14428:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787118853.592568:0:14428:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787118853.655146:0:14428:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787118853.655165:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787118853.655389:0:14451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787118853.655394:0:14451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787118853.655414:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.655441:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.655450:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.655494:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118853.655507:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 12 pid: 14429 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118853.655521:0:14451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566253056:0@lo:104: 00000100:00100000:3.0:1787118853.655596:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118853.655769:0:14451:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351563300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118853.655986:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253056 00000100:00100000:2.0:1787118853.655994:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253056 00000100:00100000:2.0:1787118853.656034:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118853.656043:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566253056:12345-0@lo:104: 00010000:00010000:2.0:1787118853.656055:0:14419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656103:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787118853.656109:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566253056:12345-0@lo:104: Request processed in 68us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.656115:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787118853.656135:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118853.656140:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656146:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81400 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118853.656150:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656157:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118853.656163:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118853.656168:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787118853.656199:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656205:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118853.656220:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656225:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136eb81400/0xaa534e3c784f9613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f961a expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656240:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118853.656242:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118853.656243:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118853.656271:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566253184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118853.656298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118853.656353:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253184 00000100:00100000:2.0:1787118853.656357:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253184 00010000:00010000:2.0:1787118853.656373:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 13 pid: 14429 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118853.656393:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118853.656399:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+13:3301:x1873929566253184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118853.656408:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118853.656412:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 13 pid: 14429 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656428:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 13 pid: 14429 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656444:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656458:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787118853.656470:0:14421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001075838s 00010000:00010000:2.0:1787118853.656484:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656491:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656497:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656503:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656508:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118853.656512:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656518:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656525:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.656534:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118853.656565:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+13:3301:x1873929566253184:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.656571:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118853.657080:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566253184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118853.657114:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f961a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f9613 expref: 12 pid: 14429 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118853.657124:0:14451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566253056:0@lo:104: 00010000:00010000:2.0:1787118853.657140:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.657148:0:14451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.657154:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118853.657160:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042400/0xaa534e3c784f964b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118853.667597:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14418:x1873929566252928:12345-0@lo:253:mount.lustre.0 Request processed in 76205us (76305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118853.667621:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787118853.667756:0:14418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:14418:1873929566252928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787118853.667772:0:14418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787118853.667774:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787118853.667776:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787118853.667777:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118853.667778:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118853.667779:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118853.667781:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118853.667782:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787118853.667783:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787118853.667785:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118853.667786:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787118853.667799:0:14418:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787118853.682874:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.685533:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118853.686664:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.686906:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118853.689150:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.689319:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118853.691697:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.691895:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118853.692288:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.692542:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118853.692866:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118853.693307:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787118853.734704:0:14418:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787118853.735132:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787118853.735191:0:14474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787118853.735194:0:14474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787118853.735410:0:14475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787118853.735485:0:14475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118853.737917:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787118853.739673:0:14475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787118853.739684:0:14475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787118853.741179:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787118853.741289:0:14418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787118853.741808:0:14418:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787118853.741815:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787118853.743746:0:14418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118853.744831:0:14418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787118853.746235:0:14418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787118853.746292:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787118853.748846:0:14418:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1787118853.751195:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787118853.764699:0:14418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787118853.799088:0:14418:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787118853.799120:0:14418:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa89d41bcf988 00100000:10000000:1.0:1787118853.799128:0:14418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787118853.799909:0:14418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787118853.799924:0:14418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787118853.799937:0:14418:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787118853.799971:0:14418:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787118854.282915:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787118854.604703:0:14466:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787118854.604712:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787118854.605110:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787118854.605116:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1787118855.177838:0:14433:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787118855.177845:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96137863b800 from 6 10000000:01000000:2.0:1787118855.177850:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787118855.177894:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118855.177905:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118855.177916:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118855.177950:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566253312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787118855.178013:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118855.178078:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118855.178135:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253312 00000100:00100000:0.0:1787118855.178144:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253312 00000100:00100000:0.0:1787118855.178205:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787118855.178214:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14433:x1873929566253312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118855.178227:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118855.178243:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9652 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118855.178264:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118855.178275:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118855.178284:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81000, rc 0) 00000100:00100000:0.0:1787118855.178328:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566253312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118855.178335:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787118855.178738:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566253312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118855.178755:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118855.178765:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118855.178828:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566253440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787118855.178861:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118855.178887:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9612411a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118855.178947:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253440 00000100:00100000:0.0:1787118855.178952:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253440 00000100:00100000:0.0:1787118855.178982:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787118855.178989:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566253440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787118855.179012:0:14428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787118855.179027:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787118855.179030:0:14428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787118855.179119:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566253440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118855.179126:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787118855.179372:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566253440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787118855.179488:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787118855.179496:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118855.179503:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118855.306304:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118855.629460:0:14466:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787118855.629482:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118855.630518:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787118855.630595:0:14466:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787118855.630630:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1787118856.330688:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118857.353952:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118858.393375:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787118859.085661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118859.085668:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787118859.085671:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118859.085673:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787118859.085676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787118859.085679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787118859.085683:0:8:0:(import.c:65:import_set_state_nolock()) ffff9613756da000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118859.085693:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9613756da000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118859.085715:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a766d80 x1873929566253696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787118859.085768:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566253696:0@lo:38:kworker.0 00000100:00100000:0.0:1787118859.085834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118859.085972:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566253568:0@lo:400:kworker.0 00000100:00100000:3.0:1787118859.086005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118859.086206:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253568 00000100:00100000:0.0:1787118859.086213:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253568 00000100:00100000:0.0:1787118859.086264:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787118859.086274:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:3298:x1873929566253568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118859.086337:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:3298:x1873929566253568:12345-0@lo:400:kworker.0 Request processed in 64us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118859.086344:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787118859.086391:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566253568:0@lo:400:kworker.0 00000100:00100000:2.0:1787118859.086702:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253696 00000100:00100000:2.0:1787118859.086707:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253696 00000100:00100000:2.0:1787118859.086753:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118859.086759:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566253696:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787118859.086780:0:14437:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1787118859.086816:0:14437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa534e3c784f9660 00000004:00100000:2.0:1787118859.086832:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787118859.086966:0:14437:0:(import.c:65:import_set_state_nolock()) ffff961350b47800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118859.087017:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873929566253696:12345-0@lo:38:kworker.0 Request processed in 258us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118859.087024:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787118859.087069:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96137a766d80 x1873929566253696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787118859.087092:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787118859.087099:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787118859.087103:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787118859.087105:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613756da000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787118859.087110:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873929566253696:0@lo:38:kworker.0 00000001:02000400:2.0:1787118859.137154:0:14718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787118859.402289:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118860.426087:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118861.453887:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118862.476549:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787118862.489648:0:14868:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff208d4000 20000000:00000080:1.0:1787118862.489666:0:14868:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961376c90400 uarg=0000000000000000 20000000:01000000:1.0:1787118862.489698:0:14868:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787118862.489974:0:14868:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787118862.489978:0:14868:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787118862.490698:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787118862.491010:0:14868:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787118862.498496:0:14868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787118862.498527:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.498546:0:14868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.498562:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.498623:0:14868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.498639:0:14868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118862.498653:0:14868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14868:1873929566253824:0@lo:104: 00000100:00100000:1.0:1787118862.499204:0:14868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118862.499262:0:14868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613601cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118862.499477:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253824 00000100:00100000:2.0:1787118862.499484:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253824 00000100:00100000:2.0:1787118862.499534:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118862.499544:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14868:x1873929566253824:12345-0@lo:104: 00010000:00010000:2.0:1787118862.499566:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118862.499624:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787118862.499630:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14868:x1873929566253824:12345-0@lo:104: Request processed in 89us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118862.499636:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787118862.499864:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118862.499871:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.499878:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:0.0:1787118862.499894:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.499902:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787118862.499908:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118862.499913:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787118862.499941:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.499947:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787118862.499975:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.499981:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f9621 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9628 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.499992:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118862.499994:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118862.499996:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118862.500007:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566253952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787118862.500037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118862.500078:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566253952 00000100:00100000:0.0:1787118862.500082:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566253952 00010000:00010000:0.0:1787118862.500099:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 12 pid: 14429 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118862.500121:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118862.500127:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:3299:x1873929566253952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118862.500136:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118862.500141:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 12 pid: 14429 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500151:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 12 pid: 14429 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500166:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500174:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500198:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500204:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500211:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500217:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500221:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118862.500224:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500231:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500240:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118862.500248:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118862.500279:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:3299:x1873929566253952:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118862.500285:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118862.500319:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566253952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118862.501045:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986e00/0xaa534e3c784f9628 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f9621 expref: 11 pid: 14429 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118862.501057:0:14868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14868:1873929566253824:0@lo:104: 00010000:00010000:1.0:1787118862.501074:0:14868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.501085:0:14868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.501091:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118862.501098:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8e00/0xaa534e3c784f9667 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118863.177840:0:3297:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787118853/real 1787118853] req@ffff96124139a300 x1873929566251008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118863.177874:0:3297:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96124139a300 x1873929566251008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118863.177885:0:3297:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787118853/real 1787118853] req@ffff96137a765880 x1873929566250880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118863.177920:0:3297:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96137a765880 x1873929566250880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787118863.177938:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787118863.177951:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787118863.177955:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566251008:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787118863.177960:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613503a4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787118863.177965:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787118863.177968:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566250880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787118863.178200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118863.178205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787118863.178219:0:8:0:(import.c:65:import_set_state_nolock()) ffff9613503a4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118863.178224:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:0.0:1787118863.178229:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787118863.178237:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9613503a4800 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118863.178261:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a764700 x1873929566254208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787118863.178279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118863.178282:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787118863.178283:0:8:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118863.178286:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:0.0:1787118863.178289:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787118863.178294:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9613500c3000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118863.178307:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a767480 x1873929566254336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787118863.178345:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566254208:0@lo:8:kworker.0 00000400:00000100:0.0:1787118863.178392:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873929566254208 offset 0 length 520: 4 00000100:00100000:0.0:1787118863.178451:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566254336:0@lo:8:kworker.0 00000400:00000100:0.0:1787118863.178485:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873929566254336 offset 0 length 520: 4 00000100:00100000:1.0:1787118863.178562:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566254464:0@lo:400:kworker.0 00000100:00100000:1.0:1787118863.178601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118863.178630:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787118863.178643:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566254080:0@lo:400:kworker.0 00000100:00100000:1.0:1787118863.178673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118863.178797:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254464 00000100:00100000:0.0:1787118863.178931:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254464 00000100:00100000:0.0:1787118863.178987:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118863.178997:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118863.179112:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566254464:12345-0@lo:400:kworker.0 Request processed in 117us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118863.179119:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118863.179150:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254080 00000100:00100000:0.0:1787118863.179154:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254080 00000100:00100000:0.0:1787118863.179179:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787118863.179185:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+11:3301:x1873929566254080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118863.179224:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+11:3301:x1873929566254080:12345-0@lo:400:kworker.0 Request processed in 39us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118863.179231:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787118863.195600:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96137a765180 x1873929566254464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787118863.195621:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566254464:0@lo:400:kworker.0 00000100:00100000:1.0:1787118863.195650:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566254080:0@lo:400:kworker.0 00010000:00010000:3.0:1787118863.506050:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787118863.886252:0:14433:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787118863.886261:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137863b800 from 10 10000000:01000000:1.0:1787118863.886265:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787118863.886319:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118863.886331:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118863.886341:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118863.886366:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118863.886442:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118863.886561:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118863.888575:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254592 00000100:00100000:3.0:1787118863.888587:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254592 00000100:00100000:3.0:1787118863.888701:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787118863.888743:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+11:14433:x1873929566254592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118863.888757:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118863.888787:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f966e expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118863.888830:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f966e expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118863.888840:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f966e expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118863.888867:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042200, rc 0) 00000100:00100000:3.0:1787118863.888947:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566254592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118863.888954:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118863.889041:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118863.889058:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118863.889067:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118863.889143:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118863.889173:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118863.890743:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118863.891440:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254720 00000100:00100000:0.0:1787118863.891451:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254720 00000100:00100000:0.0:1787118863.891501:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787118863.891510:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566254720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118863.892281:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566254720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 770us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118863.892289:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787118863.892404:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787118863.892459:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787118863.892502:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118863.892537:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118863.892590:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254848 00000100:00100000:0.0:1787118863.892594:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254848 00000100:00100000:0.0:1787118863.892615:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787118863.892622:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566254848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118863.893204:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:14433:x1873929566254848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 580us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118863.893211:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787118863.893627:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566254848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787118863.895493:0:14929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787118863.897142:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787118863.897172:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787118863.897183:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118863.897195:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118864.527298:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118865.548047:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118865.866473:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787118866.571197:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787118867.588242:0:15117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787118867.588246:0:15117:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787118867.588353:0:15117:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff961375690800 00000020:01000004:1.0:1787118867.588368:0:15117:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787118867.588378:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787118867.589361:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96137abccd40) 00000020:00000080:1.0:1787118867.589391:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1787118867.594298:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787118867.605107:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787118867.605335:0:15117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787118867.606670:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787118867.607395:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787118867.607625:0:15117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787118867.608348:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 475: rc = 0 00100000:10000000:0.0:1787118867.608465:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 475: rc = 0 00100000:10000000:0.0:1787118867.608558:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 475: rc = 0 00100000:10000000:0.0:1787118867.609588:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 549: rc = 0 00100000:10000000:0.0:1787118867.610112:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 549: rc = 0 00100000:10000000:0.0:1787118867.610513:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 549: rc = 0 00100000:10000000:0.0:1787118867.610942:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 549: rc = 0 00100000:10000000:0.0:1787118867.611343:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 549: rc = 0 00100000:10000000:0.0:1787118867.611625:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 549: rc = 0 00000020:00000080:0.0:1787118867.612551:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787118867.612562:0:15117:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787118867.612573:0:15117:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa534e3c784f9683 00000020:01000004:0.0:1787118867.612580:0:15117:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787118867.612600:0:15117:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.110@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787118867.612603:0:15117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787118867.612609:0:15117:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787118867.612614:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787118867.612624:0:15117:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9613496a3380) 00000020:00000080:0.0:1787118867.612634:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787118867.614476:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118867.614649:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787118867.614656:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787118867.615598:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787118867.615606:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787118867.618754:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787118867.618768:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787118867.620517:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118867.620693:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787118867.620699:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787118867.621909:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787118867.621919:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787118867.656543:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787118867.656915:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787118867.656922:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787118867.658486:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787118867.658496:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787118867.664051:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787118867.664069:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787118867.683677:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787118867.685124:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787118867.685132:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787118867.690754:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787118867.690771:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787118867.737278:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787118867.737479:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787118867.737486:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787118867.739165:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787118867.739184:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787118867.739619:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787118867.739641:0:15117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787118867.739646:0:15117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787118867.747078:0:15117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787118867.747115:0:15117:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.110@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787118867.747119:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787118867.747120:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118867.747122:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118867.747123:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118867.747124:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118867.747125:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118867.747131:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118867.747133:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118867.747134:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118867.747138:0:15117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787118867.747140:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787118867.747141:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118867.747141:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118867.747142:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118867.747143:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118867.747144:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118867.747145:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118867.747145:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118867.747146:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118867.747169:0:15117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787118867.747189:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566254976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787118867.747252:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.747360:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118867.747418:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566254976 00000100:00100000:0.0:1787118867.747426:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566254976 00000100:00100000:0.0:1787118867.747534:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787118867.747544:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:15117:x1873929566254976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787118867.747584:0:14428:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787118867.747588:0:14428:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787118867.747591:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787118867.760617:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:15117:x1873929566254976:12345-0@lo:253:mount.lustre.0 Request processed in 13066us (13356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.760631:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787118867.760762:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566254976:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787118867.760778:0:15117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787118867.760782:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787118867.760783:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118867.760784:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118867.760786:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118867.760787:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118867.760788:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118867.760789:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118867.760791:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118867.760792:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787118867.760812:0:15117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff961375690800 from lustre-OST0000 10000000:01000000:2.0:1787118867.760838:0:15117:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787118867.760841:0:15117:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787118867.760906:0:15117:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96137a6b3380 local copy 00010000:00010000:2.0:1787118867.760917:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118867.761196:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118867.761233:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.761265:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.761748:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255104 00000100:00100000:1.0:1787118867.761763:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255104 00000100:00100000:1.0:1787118867.761806:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787118867.761815:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:15117:x1873929566255104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787118867.762115:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+12:15117:x1873929566255104:12345-0@lo:501:mount.lustre.0 Request processed in 300us (880us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787118867.762122:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787118867.762292:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255104:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787118867.762309:0:15117:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787118867.762467:0:15117:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787118867.762475:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.762485:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118867.762509:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff961375690800 10000000:01000000:2.0:1787118867.762514:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787118867.762519:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96137a6b3380 10000000:01000000:2.0:1787118867.762521:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787118867.762525:0:15117:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff96137a6b3380 from 1 10000000:01000000:2.0:1787118867.762527:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787118867.762552:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.762559:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.762568:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118867.762585:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787118867.762612:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.762642:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.762691:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255232 00000100:00100000:1.0:1787118867.762696:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255232 00000100:00100000:1.0:1787118867.762752:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787118867.762759:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+12:15117:x1873929566255232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118867.762768:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118867.762781:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9c00/0xaa534e3c784f9698 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9691 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.762801:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9c00/0xaa534e3c784f9698 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9691 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.762811:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9c00/0xaa534e3c784f9698 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9691 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.762819:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9c00, rc 0) 00000100:00100000:1.0:1787118867.763236:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+13:15117:x1873929566255232:12345-0@lo:101:mount.lustre.0 Request processed in 476us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.763242:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787118867.763423:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118867.763437:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9698 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.763446:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9698 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118867.763462:0:15117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787118867.763517:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9698 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.763525:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e986200/0xaa534e3c784f9691 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9698 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118867.763544:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787118867.763549:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787118867.763555:0:15117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787118867.763557:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787118867.763578:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.763586:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.763594:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118867.763608:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787118867.763637:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.763670:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134642c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787118867.763750:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255360 00000100:00100000:0.0:1787118867.763755:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255360 00000100:00100000:0.0:1787118867.763786:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787118867.763794:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+13:15117:x1873929566255360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118867.763802:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118867.763812:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136eb81400/0xaa534e3c784f96a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f969f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.763827:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb81400/0xaa534e3c784f96a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f969f expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.763836:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136eb81400/0xaa534e3c784f96a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f969f expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.763843:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81400, rc 0) 00000100:00100000:0.0:1787118867.763889:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255360:12345-0@lo:101:mount.lustre.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118867.763895:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787118867.764161:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118867.764173:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96a6 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.764181:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f96a6 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787118867.766489:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787118867.767902:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787118867.768278:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787118867.768319:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787118867.768346:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787118867.768414:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787118867.768447:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787118867.768492:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787118867.768550:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787118867.768558:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787118867.768633:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118867.768688:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.768804:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134642cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118867.769036:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255488 00000100:00100000:0.0:1787118867.769044:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255488 00000100:00100000:0.0:1787118867.769117:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787118867.769126:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118867.769454:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255488:12345-0@lo:501:mount.lustre.0 Request processed in 328us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118867.769462:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787118867.769535:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118867.769569:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118867.769609:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.769717:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118867.769829:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255616 00000100:00100000:3.0:1787118867.769834:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255616 00000100:00100000:3.0:1787118867.769866:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787118867.769873:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787118867.770333:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255616:12345-0@lo:503:mount.lustre.0 Request processed in 459us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118867.770340:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787118867.770429:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787118867.770937:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118867.771010:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118867.771055:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.771088:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613412edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118867.771274:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255744 00000100:00100000:3.0:1787118867.771279:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255744 00000100:00100000:3.0:1787118867.771305:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787118867.771312:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.771517:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255744:12345-0@lo:502:mount.lustre.0 Request processed in 204us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118867.771524:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787118867.771660:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118867.772078:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787118867.772123:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787118867.772157:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787118867.772221:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787118867.772428:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787118867.772464:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787118867.772510:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787118867.772544:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787118867.772578:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787118867.772637:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787118867.772670:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787118867.772707:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787118867.772948:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118867.773055:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.773135:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613515863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.774361:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566255872 00000100:00100000:1.0:1787118867.774372:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566255872 00000100:00100000:3.0:1787118867.776904:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787118867.776923:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118867.777639:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566255872:12345-0@lo:502:mount.lustre.0 Request processed in 714us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.777654:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787118867.777939:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566255872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787118867.778101:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787118867.778123:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787118867.779233:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787118867.779242:0:15131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787118867.779248:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.779250:0:15131:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787118867.779255:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787118867.779268:0:15131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9613496a4d40) 00000020:00000080:0.0:1787118867.779287:0:15131:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787118867.779291:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787118867.779356:0:15131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961375690800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787118867.779363:0:15131:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787118867.779369:0:15131:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa534e3c784f96b4 00010000:00010000:0.0:1787118867.785400:0:15131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787118867.786329:0:15131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787118867.789562:0:15131:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787118867.791268:0:15131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787118867.791280:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118867.791286:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791288:0:15131:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787118867.791291:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787118867.791294:0:15131:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787118867.791295:0:15131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118867.791297:0:15131:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787118867.791298:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787118867.791300:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791308:0:15131:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787118867.791310:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118867.791313:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791314:0:15131:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787118867.791317:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787118867.791319:0:15131:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787118867.791321:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118867.791323:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791324:0:15131:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787118867.791326:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118867.791328:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791329:0:15131:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787118867.791332:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787118867.791395:0:15131:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118867.791399:0:15131:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118867.791400:0:15131:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787118867.791403:0:15131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787118867.797616:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787118867.797657:0:15117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787118867.797747:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96a6 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.797768:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382042e00/0xaa534e3c784f969f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96a6 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787118867.797778:0:15117:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375690800 from 1 10000000:01000000:1.0:1787118867.797781:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787118867.797816:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.797823:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.797833:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118867.797871:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787118867.797936:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118867.797990:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613486c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787118867.798899:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256000 00000100:00100000:2.0:1787118867.798908:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256000 00000100:00100000:2.0:1787118867.799052:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787118867.799064:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+14:15117:x1873929566256000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787118867.799079:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118867.799094:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f96bb expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.799118:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.799128:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118867.799138:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986400, rc 0) 00000100:00100000:2.0:1787118867.799190:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256000:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.799197:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787118867.799314:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118867.799330:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.799339:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787118867.800159:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787118867.803479:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787118867.804251:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787118867.804307:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787118867.804425:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787118867.804434:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787118867.805018:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787118867.805085:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118867.805163:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613486c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787118867.805205:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256128 00000100:00100000:2.0:1787118867.805212:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256128 00000100:00100000:2.0:1787118867.805283:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787118867.805292:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118867.805534:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256128:12345-0@lo:501:mount.lustre.0 Request processed in 242us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.805542:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787118867.805620:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118867.805657:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787118867.805697:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.806286:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961354481240 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.806352:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256256 00000100:00100000:1.0:1787118867.806358:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256256 00000100:00100000:1.0:1787118867.806393:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787118867.806401:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787118867.806607:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256256:12345-0@lo:503:mount.lustre.0 Request processed in 206us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.806614:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787118867.806687:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787118867.807427:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787118867.807498:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.807779:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.807807:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.807878:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256384 00000100:00100000:1.0:1787118867.807884:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256384 00000100:00100000:1.0:1787118867.807911:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787118867.807918:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787118867.808091:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256384:12345-0@lo:502:mount.lustre.0 Request processed in 172us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.808098:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787118867.808287:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787118867.808493:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787118867.808551:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787118867.808594:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787118867.808624:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787118867.808651:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787118867.808698:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787118867.808765:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787118867.808803:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787118867.808831:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.808884:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.808908:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.809200:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256512 00000100:00100000:1.0:1787118867.809206:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256512 00000100:00100000:1.0:1787118867.809235:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787118867.809243:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787118867.809401:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256512:12345-0@lo:502:mount.lustre.0 Request processed in 158us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.809408:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787118867.810015:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787118867.810132:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787118867.810145:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787118867.811296:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118867.811310:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811312:0:15135:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787118867.811318:0:15135:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961375690800 00000020:00000080:1.0:1787118867.811321:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787118867.811328:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118867.811330:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811331:0:15135:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787118867.811333:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118867.811335:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811337:0:15135:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787118867.811339:0:15135:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff961375690800 00000020:00000080:1.0:1787118867.811341:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787118867.811401:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118867.811405:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811406:0:15135:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787118867.811408:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787118867.811410:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811412:0:15135:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787118867.811415:0:15135:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff961375690800 00000020:00000080:1.0:1787118867.811417:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787118867.811448:0:15135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787118867.811451:0:15135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118867.811452:0:15135:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787118867.811455:0:15135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787118867.812755:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787118867.812790:0:15117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787118867.812809:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.812820:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118867.813613:0:15117:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787118867.813618:0:15117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff961375690800 10000000:01000000:3.0:1787118867.813621:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff961375690800 10000000:01000000:3.0:1787118867.813625:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787118867.813632:0:15117:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff961375690800 from 1 10000000:01000000:3.0:1787118867.813634:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787118867.813670:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.813681:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.813692:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118867.813715:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787118867.814123:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.814168:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.814264:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256640 00000100:00100000:1.0:1787118867.814271:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256640 00000100:00100000:1.0:1787118867.814311:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787118867.814320:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:15117:x1873929566256640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118867.814333:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118867.814345:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8a00/0xaa534e3c784f96d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f96c9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.814368:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8a00/0xaa534e3c784f96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f96c9 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.814401:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8a00/0xaa534e3c784f96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f96c9 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.814410:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8a00, rc 0) 00000100:00100000:1.0:1787118867.814447:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566256640:12345-0@lo:101:mount.lustre.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.814453:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787118867.814600:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118867.814614:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96d0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.814623:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f96d0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787118867.816706:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787118867.818333:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787118867.820224:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787118867.820298:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787118867.820335:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787118867.820397:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787118867.820436:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787118867.820482:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787118867.822485:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787118867.823079:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787118867.823142:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787118867.823172:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787118867.823207:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787118867.823279:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787118867.823331:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787118867.823362:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787118867.826702:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787118867.826811:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787118867.827052:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787118867.827107:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787118867.827138:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787118867.827164:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787118867.827207:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787118867.827246:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787118867.827284:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787118867.827334:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787118867.827374:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787118867.827424:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787118867.827473:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787118867.829836:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787118867.830135:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787118867.830151:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787118867.830263:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118867.830330:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.830376:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118867.830544:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256768 00000100:00100000:2.0:1787118867.830556:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256768 00000100:00100000:2.0:1787118867.830599:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787118867.830606:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566256768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118867.830856:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566256768:12345-0@lo:501:mount.lustre.0 Request processed in 238us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.830863:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787118867.831638:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118867.831677:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787118867.833056:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.833107:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118867.833204:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566256896 00000100:00100000:0.0:1787118867.833212:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566256896 00000100:00100000:0.0:1787118867.833262:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787118867.833271:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566256896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118867.833462:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566256896:12345-0@lo:503:mount.lustre.0 Request processed in 192us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118867.833469:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787118867.834201:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566256896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787118867.836316:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787118867.836426:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.836498:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.836550:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257024 00000100:00100000:3.0:1787118867.836557:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257024 00000100:00100000:3.0:1787118867.836600:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787118867.836609:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.836821:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257024:12345-0@lo:502:mount.lustre.0 Request processed in 213us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118867.836829:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787118867.837861:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff961349dac240 going to sleep for 11 seconds 00000100:00100000:0.0:1787118867.837890:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787118867.838290:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787118867.838350:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787118867.838397:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787118867.838439:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787118867.838468:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787118867.842082:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787118867.842178:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787118867.842214:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787118867.842285:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787118867.842320:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787118867.842348:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787118867.842402:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787118867.842434:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787118867.842466:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787118867.842514:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787118867.842549:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787118867.842583:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787118867.842630:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787118867.842666:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787118867.842699:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787118867.842782:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787118867.842819:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787118867.842864:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787118867.842915:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787118867.848678:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787118867.851605:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787118867.851709:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787118867.851776:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787118867.851814:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787118867.851932:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787118867.851972:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787118867.851998:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787118867.852015:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787118867.852040:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787118867.852065:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787118867.852188:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787118867.852228:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787118867.852282:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787118867.852343:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787118867.852391:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787118867.852440:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118867.852513:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.852560:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787118867.852802:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257152 00000100:00100000:3.0:1787118867.852810:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257152 00000100:00100000:3.0:1787118867.853193:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787118867.853206:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787118867.853477:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257152:12345-0@lo:502:mount.lustre.0 Request processed in 274us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118867.853493:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787118867.861313:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118867.861479:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787118867.861495:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787118867.867012:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787118867.867029:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff961346264d40) 00000020:00000080:2.0:1787118867.867052:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787118867.874292:0:15140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961375690800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787118867.874301:0:15140:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961375690800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787118867.874304:0:15140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961375690800 3 00010000:00080000:2.0:1787118867.874347:0:15140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96136e9b8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.110@tcp at head 00010000:00010000:2.0:1787118867.883674:0:15140:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787118867.885833:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787118867.886055:0:15140:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787118867.886067:0:15140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa534e3c784f96de 00000100:00080000:2.0:1787118867.886079:0:15140:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787118867.886085:0:15140:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96136e9b8000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118867.886123:0:15140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a748000 x1873929566257280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787118867.886148:0:15140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787118867.888121:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566257280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787118867.888189:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.888631:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257280 00000100:00100000:2.0:1787118867.888638:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257280 00000100:00100000:2.0:1787118867.888672:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787118867.888679:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1873929566257280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787118867.888703:0:14435:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1787118867.888775:0:14435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa534e3c784f96e5 00000004:00100000:2.0:1787118867.888790:0:14435:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787118867.888820:0:14435:0:(import.c:65:import_set_state_nolock()) ffff96137b486800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787118867.889088:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873929566257280:12345-0@lo:38:llog_process_th.0 Request processed in 407us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.889096:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787118867.889246:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1787118867.889463:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96137a748000 x1873929566257280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118867.889473:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787118867.889481:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787118867.889488:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787118867.889511:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787118867.889515:0:3297:0:(import.c:65:import_set_state_nolock()) ffff96136e9b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787118867.889521:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1873929566257280:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787118867.890199:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787118867.890231:0:15117:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118867.890250:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96d0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.890260:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382042800/0xaa534e3c784f96c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96d0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787118867.890308:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787118867.890310:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787118867.890311:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118867.890313:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118867.890314:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118867.890316:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118867.890317:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118867.890319:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118867.890320:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787118867.890324:0:15117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787118867.890326:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787118867.890328:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787118867.890329:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118867.890330:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118867.890331:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118867.890332:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118867.890333:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118867.890334:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118867.890336:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787118867.890356:0:15117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787118867.890371:0:15117:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257408:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787118867.890428:0:15117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118867.890465:0:15117:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613487690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118867.890622:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257408 00000100:00100000:2.0:1787118867.890628:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257408 00000100:00100000:2.0:1787118867.890666:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787118867.890674:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787118867.890696:0:14428:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787118867.890715:0:14428:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1787118867.892070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787118867.892078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787118867.892081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787118867.892083:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787118867.892193:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566257536:0@lo:400:kworker.0 00000100:00100000:2.0:1787118867.892243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118867.892301:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257536 00000100:00100000:2.0:1787118867.892306:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257536 00000100:00100000:2.0:1787118867.892349:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118867.892357:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566257536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118867.892414:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566257536:12345-0@lo:400:kworker.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118867.892421:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787118867.892457:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff961375ccea00 x1873929566257536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118867.892470:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566257536:0@lo:400:kworker.0 20000000:01000000:2.0:1787118867.936078:0:14428:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787118867.936126:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787118867.938097:0:14451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787118867.938107:0:14451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1787118867.944137:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15117:x1873929566257408:12345-0@lo:253:mount.lustre.0 Request processed in 53455us (53700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118867.944152:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787118867.944350:0:15117:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15117:1873929566257408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787118867.944364:0:15117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787118867.944367:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787118867.944369:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787118867.944370:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118867.944371:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118867.944373:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118867.944374:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118867.944375:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118867.944377:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118867.944389:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787118867.944405:0:15117:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787118867.945631:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.945649:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.945657:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.945705:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.945871:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 15 pid: 14430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118867.945889:0:14451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566257664:0@lo:104: 00000100:00100000:0.0:1787118867.945943:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118867.946056:0:14451:0:(client.c:2702:ptlrpc_set_wait()) set ffff961346150780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118867.946144:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257664 00000100:00100000:1.0:1787118867.946152:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257664 00000100:00100000:1.0:1787118867.946194:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787118867.946203:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566257664:12345-0@lo:104: 00010000:00010000:1.0:1787118867.946215:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118867.946351:0:14451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566257664:0@lo:104: 00010000:00010000:0.0:1787118867.946368:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.947603:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787118867.947616:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566257664:12345-0@lo:104: Request processed in 1412us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.947624:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787118867.951593:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118867.951608:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.951621:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986c00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118867.951626:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.951636:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118867.951643:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118867.951649:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787118867.952000:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.952008:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118867.952040:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.952047:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136e986c00/0xaa534e3c784f9652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9659 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118867.952068:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118867.952070:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118867.952072:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118867.952676:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566257792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787118867.952772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118867.952855:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257792 00000100:00100000:1.0:1787118867.952863:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257792 00010000:00010000:1.0:1787118867.952887:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 16 pid: 14430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118867.952916:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787118867.952926:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3299:x1873929566257792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118867.952938:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118867.952944:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 16 pid: 14430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.952966:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 16 pid: 14430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.952981:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136eb81000/0xaa534e3c784f9659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f9652 expref: 16 pid: 14430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.952994:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953001:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787118867.953014:0:14423:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014908561s 00010000:00010000:1.0:1787118867.953019:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953025:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953031:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953044:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953050:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118867.953054:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953061:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953075:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118867.953086:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118867.953121:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a15e2bd8-d402-42e4-a923-f01b19147eee+15:3299:x1873929566257792:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118867.953129:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787118867.953164:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566257792:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1787118867.953616:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118867.954065:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787118867.954229:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118867.954389:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787118867.955184:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787118867.955430:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:0.0:1787118867.956077:0:14451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.956091:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118867.956106:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136eb80c00/0xaa534e3c784f96ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787118867.957294:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787118868.042433:0:15117:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787118868.042440:0:15117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787118868.042475:0:15117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787118868.042526:0:15117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787118868.042542:0:15117:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787118868.042567:0:15117:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787118868.620979:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787118869.196789:0:14433:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787118869.196797:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96137863b800 from 7 10000000:01000000:1.0:1787118869.196801:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787118869.196854:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118869.196866:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118869.196877:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118869.196915:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566257920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118869.196979:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118869.197033:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351af7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787118869.199611:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566257920 00000100:00100000:3.0:1787118869.199623:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566257920 00000100:00100000:3.0:1787118869.199688:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787118869.199698:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+15:14433:x1873929566257920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118869.199716:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118869.199757:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f96f3 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118869.199784:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 16 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118869.199795:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 16 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118869.199805:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961382042600, rc 0) 00000100:00100000:3.0:1787118869.200079:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:14433:x1873929566257920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 382us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118869.200086:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787118869.200242:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566257920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787118869.200260:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118869.200269:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118869.200344:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566258048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787118869.200395:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118869.200427:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351af7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787118869.200651:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258048 00000100:00100000:3.0:1787118869.200656:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258048 00000100:00100000:3.0:1787118869.200689:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787118869.200696:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:14433:x1873929566258048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787118869.200710:0:14428:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787118869.200745:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787118869.200749:0:14428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787118869.200832:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:14433:x1873929566258048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118869.201021:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787118869.201058:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566258048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787118869.201119:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787118869.201126:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118869.201355:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118869.641901:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118870.666062:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118871.690385:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118872.716591:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118872.909455:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a15e2bd8-d402-42e4-a923-f01b19147eee:3300:1873929566258176:0@lo:400:kworker.0 00000100:00100000:3.0:1787118872.909559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118872.909687:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258176 00000100:00100000:0.0:1787118872.909698:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258176 00000100:00100000:0.0:1787118872.909770:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787118872.909782:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3300:x1873929566258176:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787118872.909870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787118872.909876:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787118872.909879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787118872.909882:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787118872.913260:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3300:x1873929566258176:12345-0@lo:400:kworker.0 Request processed in 3464us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118872.913281:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787118872.913429:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566258304:0@lo:400:kworker.0 00000100:00100000:0.0:1787118872.913499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118872.913557:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258304 00000100:00100000:0.0:1787118872.913566:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258304 00000100:00100000:0.0:1787118872.913614:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118872.913624:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566258304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118872.913696:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566258304:12345-0@lo:400:kworker.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118872.913703:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787118872.913766:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961375ccca80 x1873929566258304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118872.913784:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566258304:0@lo:400:kworker.0 00000100:00100000:3.0:1787118872.917389:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a15e2bd8-d402-42e4-a923-f01b19147eee:3300:1873929566258176:0@lo:400:kworker.0 00000100:00100000:0.0:1787118872.918414:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787118872.925799:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566258432:0@lo:400:kworker.0 00000100:00100000:1.0:1787118872.925909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118872.926075:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258432 00000100:00100000:0.0:1787118872.926087:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258432 00000100:00100000:0.0:1787118872.926186:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118872.926198:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566258432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118872.926270:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566258432:12345-0@lo:400:kworker.0 Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118872.926277:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787118872.926324:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961375ccf800 x1873929566258432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118872.926339:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566258432:0@lo:400:kworker.0 00000100:00080000:1.0:1787118872.926556:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787118873.738984:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118874.764743:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118875.082769:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787118875.565662:0:15486:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787118875.786823:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118876.810075:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118877.842040:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787118878.030815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787118878.030822:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787118878.030834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787118878.030837:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787118878.030892:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566258816:0@lo:400:kworker.0 00000100:00100000:2.0:1787118878.030964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118878.031028:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118878.031035:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566258688:0@lo:400:kworker.0 00000100:00100000:2.0:1787118878.031057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118878.031436:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566258560:0@lo:400:kworker.0 00000100:00100000:3.0:1787118878.031480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118878.031545:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258560 00000100:00100000:3.0:1787118878.031553:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258560 00000100:00100000:3.0:1787118878.031598:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787118878.031607:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3299:x1873929566258560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118878.031658:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3299:x1873929566258560:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118878.031665:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787118878.031710:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566258560:0@lo:400:kworker.0 00000100:00100000:2.0:1787118878.031912:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258816 00000100:00100000:2.0:1787118878.031917:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258816 00000100:00100000:2.0:1787118878.031947:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258688 00000100:00100000:2.0:1787118878.031950:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258688 00000100:00100000:2.0:1787118878.031963:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118878.031968:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566258816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118878.032007:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566258816:12345-0@lo:400:kworker.0 Request processed in 38us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118878.032013:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118878.032025:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118878.032030:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566258688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118878.032059:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566258688:12345-0@lo:400:kworker.0 Request processed in 29us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118878.032199:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787118878.032368:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a74a680 x1873929566258688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118878.032382:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566258688:0@lo:400:kworker.0 00010000:00080000:2.0:1787118878.032398:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a74bb80 x1873929566258816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118878.032418:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566258816:0@lo:400:kworker.0 00000100:00080000:1.0:1787118878.032626:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118878.153915:0:3297:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787118863/real 1787118863] req@ffff96137a764700 x1873929566254208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118878.153944:0:3297:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96137a764700 x1873929566254208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118878.153954:0:3297:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787118863/real 1787118863] req@ffff96137a767480 x1873929566254336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787118878.153965:0:3297:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96137a767480 x1873929566254336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787118878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787118878.153981:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613503a4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787118878.154000:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787118878.154005:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566254208:0@lo:8:kworker.0 00000100:00080000:3.0:1787118878.154010:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787118878.154013:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787118878.154016:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566254336:0@lo:8:kworker.0 00000100:00080000:0.0:1787118878.154121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118878.154126:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787118878.154129:0:36:0:(import.c:65:import_set_state_nolock()) ffff9613503a4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118878.154134:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1787118878.154138:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787118878.154144:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9613503a4800 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118878.154172:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a765500 x1873929566258944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787118878.154186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118878.154190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787118878.154191:0:36:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118878.154200:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1787118878.154203:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787118878.154206:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9613500c3000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118878.154217:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a764380 x1873929566259072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118878.154274:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566258944:0@lo:8:kworker.0 00000100:00100000:3.0:1787118878.154342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118878.154393:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566259072:0@lo:8:kworker.0 00000100:00100000:3.0:1787118878.154417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118878.154496:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566258944 00000100:00100000:0.0:1787118878.154502:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566258944 00000100:00100000:0.0:1787118878.154530:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259072 00000100:00100000:0.0:1787118878.154533:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259072 00000100:00100000:0.0:1787118878.154545:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118878.154550:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1873929566258944:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787118878.154575:0:15118:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1787118878.154599:0:15118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f9701 00002000:00100000:0.0:1787118878.154613:0:15118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96136e4dd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113903 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787118878.154616:0:15118:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787118878.154619:0:15118:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787118878.154953:0:15118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787118878.154974:0:15118:0:(import.c:65:import_set_state_nolock()) ffff96136e4d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118878.155024:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1873929566258944:12345-0@lo:8:kworker.0 Request processed in 472us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118878.155032:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118878.155047:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118878.155051:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1873929566259072:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787118878.155061:0:15118:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787118878.155085:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1873929566259072:12345-0@lo:8:kworker.0 Request processed in 33us (667us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787118878.155101:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787118878.155134:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a765500 x1873929566258944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787118898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118878.155145:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787118878.155151:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787118878.155158:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787118878.155163:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787118878.155165:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613503a4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787118878.155177:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787118878.155182:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566258944:0@lo:8:kworker.0 00000100:00080000:0.0:1787118878.155193:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787118878.155196:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787118878.155199:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566259072:0@lo:8:kworker.0 00000004:00080000:0.0:1787118878.155242:0:14458:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787118878.155256:0:14458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14458:1873929566259328:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787118878.155279:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118878.155294:0:14458:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e831d80 going to sleep for 11 seconds 00000004:00080000:0.0:1787118878.155319:0:14457:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787118878.155515:0:14457:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457312791665ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787118878.155540:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566259200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118878.155566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118878.155878:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259328 00000100:00100000:0.0:1787118878.155884:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259328 00000100:00100000:0.0:1787118878.155920:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118878.155927:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14458:x1873929566259328:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787118878.157993:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259200 00000100:00100000:2.0:1787118878.158002:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259200 00000100:00100000:2.0:1787118878.158049:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118878.158058:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566259200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118878.158090:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118878.158170:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1873929566259200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118878.158178:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787118878.160844:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118878.161020:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a764380 x1873929566259200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118878.161045:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566259200:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787118878.162581:0:15118:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787118878.162591:0:15118:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787118878.162598:0:15118:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1787118878.169944:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.169956:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.169972:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.169977:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.169982:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.169999:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170010:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170018:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170043:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118878.170460:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118878.170467:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170476:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118878.170480:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170490:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170521:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118878.170522:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787118878.170529:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3dfd2c8/0xaa534e3c784f9708 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170532:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170540:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.170544:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.170547:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170555:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.170556:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170557:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118878.170559:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.170563:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170571:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.170595:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118878.170654:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118878.170660:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170667:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118878.170671:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170679:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170690:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170698:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065eaff41/0xaa534e3c784f970f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.170710:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118878.170712:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118878.170713:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.171274:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.171280:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.171289:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.171292:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.171296:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.171305:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.171333:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.171340:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.174899:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118878.174914:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.174941:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118878.174946:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.174958:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.174979:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118878.174989:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118878.174991:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118878.174993:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.179961:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787118878.179974:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000523bc4bb/0xaa534e3c784f9716 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118878.182084:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.182095:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182184:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.182188:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.182195:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182209:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182218:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182236:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182260:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118878.182274:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118878.182279:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182287:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118878.182291:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182300:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182326:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182334:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df4df2c/0xaa534e3c784f971d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.182349:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.182351:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.182352:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.183427:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.183444:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.183459:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.183463:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.183467:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.183479:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.183488:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.183495:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.183559:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.184272:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.184279:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.184291:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.184295:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.184299:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.184308:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.184335:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.184343:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185046:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118878.185054:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185071:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.185076:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185086:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185561:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185572:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7351ae3/0xaa534e3c784f9724 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185868:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.185874:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185881:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.185884:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185892:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185903:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.185921:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.185922:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.185925:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.186686:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787118878.186695:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c0744b/0xaa534e3c784f972b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118878.187473:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.187480:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187492:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.187496:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.187502:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187513:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187522:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187540:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187560:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118878.187571:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118878.187576:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187583:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118878.187587:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187595:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187608:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187616:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f9732 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.187631:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.187633:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.187634:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.188250:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.188284:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.188297:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188308:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.188320:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.188324:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188334:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188341:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188348:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188400:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.188808:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.188814:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188823:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.188826:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.188831:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188840:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188854:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.188862:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.188996:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118878.189003:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189011:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.189015:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189023:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189038:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189046:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b33e5c7/0xaa534e3c784f9739 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189062:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.189066:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189073:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.189081:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189089:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189317:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189328:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.189329:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.189331:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.189372:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787118878.189377:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9740 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.189883:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.189918:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.189925:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.189934:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.189937:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.189942:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.189951:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.189959:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.189974:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.189993:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118878.190181:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.190187:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.190195:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.190198:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.190206:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.190219:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.190225:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c80d2c71/0xaa534e3c784f9747 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.190244:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.190246:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.190247:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.190560:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.190565:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.190575:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.190578:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.190582:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.190590:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.190597:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.190603:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.190656:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.191745:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.191754:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.191773:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.191776:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.191781:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.191791:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.191801:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.191807:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.194965:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118878.194979:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.194995:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.195000:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195010:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195030:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195038:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f974e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195081:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.195086:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195093:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.195104:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195113:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195124:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.195132:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.195134:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.195136:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.195425:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787118878.195432:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f9755 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.195454:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.196585:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.196594:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.196608:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.196612:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.196619:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.196637:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.196646:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.196653:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.196678:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118878.197098:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.197105:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.197114:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.197118:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.197126:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.197143:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.197151:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f975c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.197173:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.197175:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.197176:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.198273:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.198282:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198296:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.198301:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.198307:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198328:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198337:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198355:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198374:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.198771:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.198789:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198799:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.198802:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.198806:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198815:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198823:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198830:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.198846:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787118878.199204:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.199211:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199224:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.199227:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.199232:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199240:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199248:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199254:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199261:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787118878.199646:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.199652:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199661:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.199664:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.199668:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199677:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199695:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199703:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.199711:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787118878.199846:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787118878.199854:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199863:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.199867:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199877:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199897:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199905:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9130121/0xaa534e3c784f9763 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199924:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787118878.199927:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199933:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.199942:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199949:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199958:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199963:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f976a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199975:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787118878.199978:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199985:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.199988:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.199994:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200004:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200011:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a801270a/0xaa534e3c784f9771 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200029:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118878.200032:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200038:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.200041:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200048:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200058:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200066:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49b7322/0xaa534e3c784f9778 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.200076:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.200078:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.200080:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.200085:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.200090:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.202019:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.202034:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.202045:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.202065:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.202076:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.202084:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.202166:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.203145:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.203153:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.203167:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.203171:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.203177:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.203189:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.203199:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.203207:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.203298:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118878.203308:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.203323:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.203335:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.203340:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.203350:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.203378:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.203386:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43b75d7/0xaa534e3c784f977f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.203407:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.203409:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.203411:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.203679:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787118878.203692:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.204203:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.204206:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.204208:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.204232:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.204242:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.204254:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.204263:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.204278:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.204285:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f9786 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.204303:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.204305:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.204307:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.206075:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.206087:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206109:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.206113:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.206119:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206132:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206142:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206150:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206167:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118878.206179:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118878.206184:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206192:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118878.206196:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206204:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206229:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206236:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fedac10/0xaa534e3c784f978d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206253:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.206255:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.206256:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.206702:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.206709:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206718:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.206742:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.206746:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206755:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206763:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206770:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.206796:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787118878.207185:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.207192:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207201:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.207205:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.207209:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207217:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207225:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207231:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207251:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787118878.207378:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787118878.207385:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207393:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.207396:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207405:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207419:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207432:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d0514ce/0xaa534e3c784f9794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207448:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118878.207452:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207458:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.207461:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207468:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207477:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207484:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a489a8/0xaa534e3c784f979b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.207493:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.207495:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.207496:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.207639:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.207645:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207656:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.207665:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.207670:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207680:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207688:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207695:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207709:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118878.207738:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118878.207743:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207751:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118878.207755:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.207763:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.212903:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.212931:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044633c1c/0xaa534e3c784f97a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.212961:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.212963:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118878.212966:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.213814:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.217016:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.217029:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217046:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.217051:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.217056:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217069:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217078:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217085:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217109:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118878.217261:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118878.217268:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.217282:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.217286:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.217296:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.217323:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.217331:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027ed2bfc/0xaa534e3c784f97a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.217348:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.217349:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.217351:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.217584:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.217597:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217605:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.217608:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.217612:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217621:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217628:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217635:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.217657:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118878.218023:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118878.218029:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.218037:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.218040:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.218048:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.218065:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.218073:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9378449/0xaa534e3c784f97b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.218088:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.218090:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.218092:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.218097:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.218103:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218111:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.218114:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.218119:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218128:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218142:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218150:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218172:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118878.218196:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118878.218204:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.218220:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118878.218224:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.218233:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.218246:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.218254:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9db9dd3/0xaa534e3c784f97b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118878.218280:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.218289:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118878.218292:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118878.218584:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787118878.218590:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218598:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787118878.218602:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118878.218605:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218614:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218622:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218629:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118878.218660:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787118878.218858:0:15118:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1787118878.218950:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14458:x1873929566259328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 63020us (63666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118878.218961:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118878.219012:0:14458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14458:1873929566259328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787118878.219029:0:14458:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787118878.219071:0:14458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14458:1873929566259456:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787118878.219102:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118878.219139:0:14458:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351562840 going to sleep for 11 seconds 00000100:00100000:0.0:1787118878.219159:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259456 00000100:00100000:0.0:1787118878.219165:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259456 00000100:00100000:0.0:1787118878.219218:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118878.219226:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14458:x1873929566259456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787118878.219262:0:15121:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1787118878.219267:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118878.219273:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.219282:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118878.219302:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.219320:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.219334:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.219341:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7c07cd/0xaa534e3c784f97be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118878.219364:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.219366:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118878.219367:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787118878.219775:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787118878.226036:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14458:x1873929566259456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6804us (6926us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787118878.226049:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118878.226109:0:14458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14458:1873929566259456:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787118878.226124:0:14458:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:1.0:1787118878.619940:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787118878.619987:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787118878.857884:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118879.887344:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118880.908944:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118881.929979:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787118882.944589:0:15838:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787118882.944596:0:15838:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787118882.945003:0:15838:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96137b485800 00000020:01000004:2.0:1787118882.945026:0:15838:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787118882.945041:0:15838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787118882.945057:0:15838:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff961346263380) 00000020:00000080:2.0:1787118882.945076:0:15838:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1787118882.954024:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787118882.959586:0:15838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787118882.959934:0:15838:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787118882.960626:0:15838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787118882.960997:0:15838:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787118882.961213:0:15838:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787118882.961644:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 187: rc = 0 00100000:10000000:2.0:1787118882.961796:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 187: rc = 0 00100000:10000000:2.0:1787118882.961887:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 187: rc = 0 00100000:10000000:2.0:1787118882.962404:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1787118882.962889:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1787118882.963122:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1787118882.963377:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1787118882.963603:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1787118882.963879:0:15838:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00000020:00000080:2.0:1787118882.964489:0:15838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787118882.964504:0:15838:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787118882.964518:0:15838:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa534e3c784f97cc 00000020:01000004:2.0:1787118882.964526:0:15838:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787118882.964550:0:15838:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787118882.964554:0:15838:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787118882.964560:0:15838:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787118882.964600:0:15838:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787118882.964605:0:15838:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787118882.972873:0:15838:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787118882.972927:0:15838:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.110@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787118882.972932:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787118882.972934:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118882.972935:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118882.972936:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118882.972937:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118882.972938:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118882.972940:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118882.972942:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118882.972944:0:15838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118882.972949:0:15838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787118882.972952:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787118882.972953:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118882.972954:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118882.972961:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118882.972962:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118882.972962:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118882.972963:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118882.972964:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118882.972965:0:15838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787118882.973013:0:15838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787118882.973041:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787118882.973138:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118882.973378:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13480 going to sleep for 11 seconds 00000100:00100000:0.0:1787118882.973493:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259584 00000100:00100000:0.0:1787118882.973503:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259584 00000100:00100000:0.0:1787118882.973605:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787118882.973616:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15838:x1873929566259584:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787118882.973666:0:14430:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787118882.973669:0:14430:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787118882.973674:0:14430:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787118882.984974:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15838:x1873929566259584:12345-0@lo:253:mount.lustre.0 Request processed in 11346us (11823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118882.984994:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787118882.985186:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787118882.985208:0:15838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787118882.985212:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787118882.985215:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787118882.985216:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787118882.985217:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787118882.985219:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787118882.985221:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787118882.985222:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787118882.985225:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787118882.985226:0:15838:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787118882.985257:0:15838:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96137b485800 from lustre-OST0001 10000000:01000000:2.0:1787118882.985309:0:15838:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787118882.985313:0:15838:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787118882.985324:0:15838:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96137a6b3380 local copy 00010000:00010000:2.0:1787118882.985339:0:15838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118882.985915:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118882.985974:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118882.986090:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13600 going to sleep for 11 seconds 00000100:00100000:3.0:1787118882.986141:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259712 00000100:00100000:3.0:1787118882.986151:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259712 00000100:00100000:3.0:1787118882.986255:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787118882.986267:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15838:x1873929566259712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118882.986611:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15838:x1873929566259712:12345-0@lo:501:mount.lustre.0 Request processed in 345us (636us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787118882.986620:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787118882.986707:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259712:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787118882.986759:0:15838:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787118882.986938:0:15838:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787118882.986948:0:15838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118882.986960:0:15838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81600/0xaa534e3c784f9579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9580 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118882.987004:0:15838:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96137b485800 10000000:01000000:2.0:1787118882.987011:0:15838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787118882.987017:0:15838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787118882.987020:0:15838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787118882.987025:0:15838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787118882.987029:0:15838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787118882.987060:0:15838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118882.987070:0:15838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118882.987081:0:15838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118882.987100:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787118882.987134:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118882.987891:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13600 going to sleep for 11 seconds 00000100:00100000:0.0:1787118882.987989:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259840 00000100:00100000:0.0:1787118882.987999:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259840 00000100:00100000:0.0:1787118882.988041:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787118882.988052:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:15838:x1873929566259840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118882.988067:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118882.988088:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136eb80000/0xaa534e3c784f97da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f97d3 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118882.988119:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb80000/0xaa534e3c784f97da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f97d3 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118882.988131:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136eb80000/0xaa534e3c784f97da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f97d3 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118882.988141:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80000, rc 0) 00000100:00100000:0.0:1787118882.988197:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566259840:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118882.988204:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787118882.988365:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787118882.988382:0:15838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97da expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118882.988411:0:15838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f97da expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118882.989701:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787118882.991177:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787118882.991467:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787118882.991596:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787118882.991629:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787118882.991682:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787118882.991717:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787118882.991893:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787118882.991973:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787118882.991982:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787118882.992101:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118882.992185:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118882.992329:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118882.992394:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566259968 00000100:00100000:0.0:1787118882.992403:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566259968 00000100:00100000:0.0:1787118882.992580:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787118882.992592:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566259968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118882.994087:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566259968:12345-0@lo:501:mount.lustre.0 Request processed in 1490us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118882.994102:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787118882.994451:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566259968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118882.994527:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118882.994584:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118882.997795:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13300 going to sleep for 11 seconds 00000100:00100000:3.0:1787118882.997925:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260096 00000100:00100000:3.0:1787118882.997938:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260096 00000100:00100000:3.0:1787118882.998014:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787118882.998025:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961346578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787118882.998547:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961346578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260096:12345-0@lo:503:mount.lustre.0 Request processed in 522us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118882.998556:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787118882.999339:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787118883.000246:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118883.000369:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.000451:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.000506:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13300 going to sleep for 11 seconds 00000100:00100000:1.0:1787118883.000779:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260224 00000100:00100000:1.0:1787118883.000787:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260224 00000100:00100000:1.0:1787118883.000844:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787118883.000854:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787118883.001112:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961346579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260224:12345-0@lo:502:mount.lustre.0 Request processed in 259us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118883.001127:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787118883.001640:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118883.002013:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787118883.002084:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787118883.002121:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787118883.002174:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787118883.002213:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787118883.002252:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787118883.002320:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787118883.002359:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787118883.002411:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787118883.002453:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.003677:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.003894:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118883.004338:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260352 00000100:00100000:0.0:1787118883.004348:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260352 00000100:00100000:1.0:1787118883.004434:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787118883.004448:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961346579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787118883.004932:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961346579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260352:12345-0@lo:502:mount.lustre.0 Request processed in 485us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118883.004941:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787118883.005114:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118883.005262:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787118883.005297:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787118883.006993:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787118883.007007:0:15840:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787118883.007016:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787118883.007018:0:15840:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787118883.007028:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787118883.007047:0:15840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96137abc8000) 00000020:00000080:1.0:1787118883.007077:0:15840:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787118883.007083:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787118883.007159:0:15840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137b485800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787118883.007169:0:15840:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787118883.007178:0:15840:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa534e3c784f97e8 00010000:00010000:1.0:1787118883.012366:0:15840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787118883.013614:0:15840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787118883.021666:0:15840:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787118883.033458:0:15840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787118883.039638:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118883.039662:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118883.039665:0:15840:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787118883.039672:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118883.039677:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118883.039679:0:15840:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787118883.039698:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787118883.039700:0:15840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787118883.039703:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118883.039705:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118883.039707:0:15840:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787118883.039709:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787118883.039717:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118883.039719:0:15840:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787118883.039751:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787118883.040023:0:15840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787118883.040029:0:15840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787118883.040030:0:15840:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787118883.040034:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787118883.041273:0:15838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787118883.041331:0:15838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787118883.041352:0:15838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97da expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118883.041367:0:15838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136e986000/0xaa534e3c784f97d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97da expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118883.041377:0:15838:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137b485800 from 1 10000000:01000000:0.0:1787118883.041380:0:15838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118883.041451:0:15838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118883.041460:0:15838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118883.041603:0:15838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118883.041639:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787118883.041950:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.042002:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351562a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118883.042744:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260480 00000100:00100000:1.0:1787118883.042756:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260480 00000100:00100000:1.0:1787118883.043358:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787118883.043372:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961346579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:15838:x1873929566260480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118883.043393:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118883.043417:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f97ef expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.043973:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.043990:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.044003:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8600, rc 0) 00000100:00100000:1.0:1787118883.044106:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961346579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260480:12345-0@lo:101:mount.lustre.0 Request processed in 737us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118883.044116:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787118883.044256:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787118883.044299:0:15838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118883.044327:0:15838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787118883.044958:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787118883.046429:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118883.046814:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787118883.046862:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787118883.046928:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787118883.046937:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787118883.047052:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118883.047145:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.047214:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351562a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787118883.047217:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260608 00000100:00100000:1.0:1787118883.047232:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260608 00000100:00100000:1.0:1787118883.047311:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787118883.047323:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134657a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787118883.051145:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134657a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260608:12345-0@lo:501:mount.lustre.0 Request processed in 3812us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118883.051164:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787118883.051399:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118883.051551:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118883.051641:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.052633:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118883.054604:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260736 00000100:00100000:0.0:1787118883.054623:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260736 00000100:00100000:0.0:1787118883.054709:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787118883.056374:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134657b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787118883.057447:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134657b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260736:12345-0@lo:503:mount.lustre.0 Request processed in 2721us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118883.057462:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787118883.058969:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787118883.059664:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118883.060304:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.060412:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.060519:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350b13780 going to sleep for 11 seconds 00000100:00100000:3.0:1787118883.064802:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260864 00000100:00100000:3.0:1787118883.064822:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260864 00000100:00100000:2.0:1787118883.066414:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787118883.066432:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134657b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.066916:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134657b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260864:12345-0@lo:502:mount.lustre.0 Request processed in 487us (6503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.066928:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787118883.066970:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787118883.067344:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787118883.067407:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787118883.067482:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787118883.067527:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787118883.067565:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787118883.067612:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787118883.067663:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787118883.067714:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787118883.067788:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787118883.068083:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.068138:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351562780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118883.069259:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566260992 00000100:00100000:2.0:1787118883.069284:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566260992 00000100:00100000:2.0:1787118883.069395:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787118883.069407:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613515ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.069717:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613515ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566260992:12345-0@lo:502:mount.lustre.0 Request processed in 312us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.069751:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787118883.069883:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566260992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787118883.071635:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787118883.071667:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787118883.075877:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118883.075896:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.075899:0:15844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787118883.075909:0:15844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137b485800 00000020:00000080:0.0:1787118883.075911:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787118883.075920:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118883.075923:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.075925:0:15844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787118883.075927:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118883.075929:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.075931:0:15844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787118883.075933:0:15844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96137b485800 00000020:00000080:0.0:1787118883.075936:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787118883.076010:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118883.076014:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.076015:0:15844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787118883.076018:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787118883.076021:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.076022:0:15844:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787118883.076026:0:15844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96137b485800 00000020:00000080:0.0:1787118883.076027:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787118883.076065:0:15844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787118883.076068:0:15844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787118883.076070:0:15844:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787118883.076072:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787118883.076317:0:15838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787118883.076350:0:15838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787118883.076380:0:15838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.076396:0:15838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118883.076453:0:15838:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787118883.076457:0:15838:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96137b485800 10000000:01000000:3.0:1787118883.076460:0:15838:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96137b485800 10000000:01000000:3.0:1787118883.076465:0:15838:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787118883.076482:0:15838:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96137b485800 from 1 10000000:01000000:3.0:1787118883.076486:0:15838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787118883.076546:0:15838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.076555:0:15838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.076568:0:15838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118883.076598:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787118883.076683:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118883.076935:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787118883.077099:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261120 00000100:00100000:1.0:1787118883.077110:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261120 00000100:00100000:1.0:1787118883.077166:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787118883.077176:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566261120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787118883.077194:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118883.077210:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c8200/0xaa534e3c784f9804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f97fd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.077239:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8200/0xaa534e3c784f9804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f97fd expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.077251:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c8200/0xaa534e3c784f9804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f97fd expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.077271:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8200, rc 0) 00000100:00100000:1.0:1787118883.077333:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261120:12345-0@lo:101:mount.lustre.0 Request processed in 157us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118883.077341:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787118883.077448:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787118883.077465:0:15838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9804 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.077486:0:15838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f9804 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787118883.081259:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787118883.085985:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118883.086439:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787118883.086595:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787118883.086630:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787118883.086678:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787118883.086715:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787118883.086853:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787118883.086898:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787118883.086935:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787118883.086990:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787118883.087028:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787118883.087078:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787118883.087126:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787118883.087163:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787118883.087197:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787118883.087247:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787118883.087297:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787118883.087333:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787118883.087381:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787118883.087415:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787118883.087445:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787118883.087500:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787118883.087532:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787118883.087564:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787118883.087622:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787118883.087670:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787118883.087761:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787118883.087846:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787118883.087886:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787118883.087924:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787118883.088002:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787118883.088054:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787118883.088112:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787118883.088176:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787118883.088235:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787118883.088269:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787118883.088345:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787118883.088382:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787118883.088483:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787118883.088495:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787118883.088643:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787118883.088759:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.088820:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff961351562300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118883.088950:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261248 00000100:00100000:2.0:1787118883.088961:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261248 00000100:00100000:2.0:1787118883.089021:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787118883.089032:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787118883.091560:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261248:12345-0@lo:501:mount.lustre.0 Request processed in 2516us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.091578:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787118883.099225:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787118883.099327:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787118883.099428:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118883.099504:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e9926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118883.099610:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261376 00000100:00100000:2.0:1787118883.099619:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261376 00000100:00100000:2.0:1787118883.099690:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787118883.099702:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787118883.100187:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261376:12345-0@lo:503:mount.lustre.0 Request processed in 486us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.100196:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787118883.100263:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261376:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787118883.101064:0:15838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787118883.101183:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.101245:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.101309:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261504 00000100:00100000:2.0:1787118883.101315:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261504 00000100:00100000:2.0:1787118883.101355:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787118883.101364:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.101649:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261504:12345-0@lo:502:mount.lustre.0 Request processed in 284us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.101657:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787118883.101748:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118883.101774:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118883.102006:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787118883.102060:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787118883.102092:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787118883.102137:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787118883.102174:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787118883.102223:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787118883.102260:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787118883.102309:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787118883.102364:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787118883.102425:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787118883.102463:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787118883.102513:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787118883.102553:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787118883.102592:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787118883.102643:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787118883.102681:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787118883.102769:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787118883.102822:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787118883.102861:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787118883.102896:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787118883.102948:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787118883.102987:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787118883.103021:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787118883.103067:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787118883.103103:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787118883.103154:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787118883.103205:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787118883.103245:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787118883.106938:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787118883.108408:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787118883.108512:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787118883.108545:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787118883.108575:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787118883.108635:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787118883.108664:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787118883.108703:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787118883.108770:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787118883.108805:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787118883.108858:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787118883.108897:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787118883.108965:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.109078:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.109163:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261632 00000100:00100000:2.0:1787118883.109172:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261632 00000100:00100000:2.0:1787118883.109226:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787118883.109235:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787118883.109478:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261632:12345-0@lo:502:mount.lustre.0 Request processed in 244us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.109493:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787118883.109564:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886180 going to sleep for 11 seconds 00000100:00100000:2.0:1787118883.109595:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787118883.109677:0:15838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787118883.109690:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787118883.112763:0:15848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787118883.112794:0:15848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff961241e3b380) 00000020:00000080:1.0:1787118883.112822:0:15848:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787118883.115115:0:15848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96137b485800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787118883.115129:0:15848:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96137b485800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787118883.115132:0:15848:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96137b485800 3 00010000:00080000:1.0:1787118883.115180:0:15848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961241e35800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.110@tcp at head 00010000:00010000:1.0:1787118883.119949:0:15848:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787118883.120378:0:15848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787118883.120425:0:15848:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787118883.120442:0:15848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa534e3c784f9812 00000100:00080000:1.0:1787118883.120454:0:15848:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787118883.120461:0:15848:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff961241e35800 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:1.0:1787118883.120504:0:15848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961375cced80 x1873929566261760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787118883.120539:0:15848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787118883.121063:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566261760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787118883.121171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.121254:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261760 00000100:00100000:0.0:1787118883.121263:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261760 00000100:00100000:0.0:1787118883.121318:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118883.121326:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1873929566261760:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787118883.121354:0:14437:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1787118883.121394:0:14437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa534e3c784f9819 00000004:00100000:0.0:1787118883.121414:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787118883.121457:0:14437:0:(import.c:65:import_set_state_nolock()) ffff96137f888000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118883.121523:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873929566261760:12345-0@lo:38:llog_process_th.0 Request processed in 195us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118883.121530:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787118883.121576:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961375cced80 x1873929566261760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787118893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118883.121588:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787118883.121596:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787118883.121613:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787118883.121618:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787118883.121620:0:3297:0:(import.c:65:import_set_state_nolock()) ffff961241e35800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787118883.121627:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1873929566261760:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787118883.121861:0:15848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787118883.122875:0:15838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787118883.122929:0:15838:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787118883.122953:0:15838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9804 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.122969:0:15838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961382042c00/0xaa534e3c784f97fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f9804 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787118883.123038:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787118883.123046:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787118883.123047:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118883.123048:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118883.123049:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118883.123050:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118883.123051:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118883.123052:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118883.123053:0:15838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787118883.123058:0:15838:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787118883.123060:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787118883.123061:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787118883.123062:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118883.123062:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118883.123063:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118883.123064:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118883.123065:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118883.123065:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118883.123066:0:15838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787118883.123109:0:15838:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787118883.123333:0:15838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787118883.123704:0:15838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118883.123820:0:15838:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134823fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118883.123910:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566261888 00000100:00100000:1.0:1787118883.123930:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566261888 00000100:00100000:1.0:1787118883.123996:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787118883.124007:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:15838:x1873929566261888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787118883.124042:0:14429:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787118883.124061:0:14429:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787118883.128896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787118883.128905:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787118883.128909:0:37:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787118883.128919:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1787118883.128927:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787118883.128936:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9613500c3000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:2.0:1787118883.128955:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566262016:0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.129050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.131456:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262016 00000100:00100000:2.0:1787118883.131476:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262016 00000100:00100000:2.0:1787118883.131569:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118883.131581:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566262016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.131690:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566262016:12345-0@lo:400:kworker.0 Request processed in 112us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.131698:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118883.131781:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787118883.131804:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566262016:0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.131857:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a74a680 x1873929566262144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787118883.131913:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566262144:0@lo:8:kworker.0 00000100:00100000:2.0:1787118883.131959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.132002:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262144 00000100:00100000:2.0:1787118883.132006:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262144 00000100:00100000:2.0:1787118883.132025:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118883.132030:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1873929566262144:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787118883.132083:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1873929566262144:12345-0@lo:8:kworker.0 Request processed in 52us (123us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787118883.132090:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118883.132115:0:3297:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787118883.132121:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787118883.132127:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00080000:1.0:1787118883.132327:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118883.133998:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566262144:0@lo:8:kworker.0 00000100:00100000:2.0:1787118883.134105:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566262272:0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.134191:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.134257:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262272 00000100:00100000:2.0:1787118883.134265:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262272 00000100:00100000:2.0:1787118883.134332:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118883.134341:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566262272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.134394:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873929566262272:12345-0@lo:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.134402:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787118883.134452:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a74a680 x1873929566262272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118883.134467:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873929566262272:0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.134516:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566262400:0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.134543:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118883.134573:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262400 00000100:00100000:2.0:1787118883.134576:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262400 00000100:00100000:2.0:1787118883.134607:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787118883.134612:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566262400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118883.134643:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873929566262400:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118883.134649:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787118883.134674:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96137a74a680 x1873929566262400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787118883.134683:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1873929566262400:0@lo:400:kworker.0 00000100:00080000:2.0:1787118883.134697:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1787118883.176073:0:14429:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787118883.176133:0:14429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787118883.177557:0:14451:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787118883.177569:0:14451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787118883.177600:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.177623:0:14451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.177633:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.177689:0:14451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.177706:0:14451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 19 pid: 14429 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118883.177757:0:14451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566262528:0@lo:104: 00000100:00100000:1.0:1787118883.177935:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118883.178006:0:14451:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787118883.178107:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262528 00000100:00100000:3.0:1787118883.178117:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262528 00000100:00100000:3.0:1787118883.178197:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787118883.178209:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566262528:12345-0@lo:104: 00010000:00010000:3.0:1787118883.178225:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178303:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118883.178311:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a15e2bd8-d402-42e4-a923-f01b19147eee+3:14451:x1873929566262528:12345-0@lo:104: Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118883.178319:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787118883.178347:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118883.178371:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178379:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118883.178383:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178393:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118883.178401:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118883.178407:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787118883.178445:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178452:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118883.178474:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178481:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c9000/0xaa534e3c784f96f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.178501:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118883.178503:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118883.178504:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118883.178535:0:14451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14451:1873929566262528:0@lo:104: 00010000:00010000:3.0:1787118883.178558:0:14451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118883.178949:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566262656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118883.179001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118883.179128:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262656 00000100:00100000:1.0:1787118883.179135:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262656 00010000:00010000:1.0:1787118883.179162:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 20 pid: 14429 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118883.179207:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787118883.179226:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a15e2bd8-d402-42e4-a923-f01b19147eee+20:3298:x1873929566262656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787118883.179242:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118883.179248:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 20 pid: 14429 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179259:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 20 pid: 14429 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179287:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042600/0xaa534e3c784f96fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f96f3 expref: 20 pid: 14429 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179303:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179312:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787118883.179328:0:14423:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014908561s 00010000:00010000:1.0:1787118883.179334:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179342:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179349:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179357:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179362:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118883.179373:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179382:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179399:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118883.179410:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118883.179447:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3298:x1873929566262656:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118883.179454:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787118883.179600:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566262656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787118883.179774:0:14451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.179963:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118883.179970:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8000/0xaa534e3c784f9820 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118883.190584:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:15838:x1873929566261888:12345-0@lo:253:mount.lustre.0 Request processed in 66568us (66869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118883.190605:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787118883.190708:0:15838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a15e2bd8-d402-42e4-a923-f01b19147eee:15838:1873929566261888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787118883.190948:0:15838:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787118883.190952:0:15838:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787118883.190955:0:15838:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787118883.190957:0:15838:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787118883.190958:0:15838:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787118883.190959:0:15838:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787118883.190961:0:15838:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787118883.190962:0:15838:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787118883.190965:0:15838:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787118883.190967:0:15838:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787118883.190992:0:15838:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787118883.197349:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118883.197878:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118883.198053:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118883.198205:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787118883.198387:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787118883.199066:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787118883.200029:0:15838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787118883.255965:0:15838:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787118883.255977:0:15838:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787118883.256023:0:15838:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787118883.256116:0:15838:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787118883.256144:0:15838:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787118883.256180:0:15838:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1787118883.658037:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566262784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118883.658111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118883.658227:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262784 00000100:00100000:0.0:1787118883.658235:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262784 00000100:00100000:0.0:1787118883.658407:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118883.658417:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566262784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118883.658449:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118883.658495:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566262784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118883.658502:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787118883.658539:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566262784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787118883.978019:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787118884.745980:0:14433:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787118884.745988:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96137863b800 from 8 10000000:01000000:1.0:1787118884.745994:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787118884.746038:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118884.746051:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118884.746062:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118884.746099:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566262912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787118884.746164:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118884.746223:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787118884.746508:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566262912 00000100:00100000:2.0:1787118884.746518:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566262912 00000100:00100000:2.0:1787118884.746579:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787118884.746589:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961348cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566262912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118884.746606:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118884.746620:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e987600/0xaa534e3c784f982e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9827 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118884.746645:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e987600/0xaa534e3c784f982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9827 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118884.746656:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e987600/0xaa534e3c784f982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9827 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118884.746665:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987600, rc 0) 00000100:00100000:2.0:1787118884.746712:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961348cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566262912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118884.746718:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787118884.746809:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566262912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118884.746824:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f982e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118884.746834:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f982e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118884.746892:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566263040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787118884.746933:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118884.746950:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613431b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787118884.746964:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263040 00000100:00100000:2.0:1787118884.746967:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263040 00000100:00100000:2.0:1787118884.746992:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787118884.746997:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566263040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787118884.747011:0:14429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787118884.747026:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787118884.747029:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787118884.747124:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566263040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118884.747131:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787118884.747162:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a748700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566263040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787118884.747213:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787118884.747220:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f982e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118884.747227:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96137f6c8000/0xaa534e3c784f9827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f982e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118885.002200:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787118885.323156:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787118886.030896:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118887.056692:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.076453:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787118888.271383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787118888.271389:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787118888.271393:0:8:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787118888.271405:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9613500c3000 using connection 192.168.203.110@tcp/0@lo 00000100:00100000:0.0:1787118888.271452:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96137a766300 x1873929566263424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787118888.272743:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a15e2bd8-d402-42e4-a923-f01b19147eee:3300:1873929566263168:0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.272807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118888.273210:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263168 00000100:00100000:2.0:1787118888.273217:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263168 00000100:00100000:2.0:1787118888.273269:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787118888.273277:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3300:x1873929566263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118888.273325:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3300:x1873929566263168:12345-0@lo:400:kworker.0 Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118888.273332:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787118888.273447:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a15e2bd8-d402-42e4-a923-f01b19147eee:3300:1873929566263168:0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.273455:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566263808:0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.273488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118888.273521:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787118888.273528:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566263296:0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.273657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118888.273959:0:3297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566263424:0@lo:8:kworker.0 00000100:00100000:0.0:1787118888.273990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118888.274020:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566263680:0@lo:400:kworker.0 00000100:00100000:0.0:1787118888.274044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118888.274193:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118888.274200:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566263552:0@lo:400:kworker.0 00000100:00100000:0.0:1787118888.274223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118888.274528:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263808 00000100:00100000:0.0:1787118888.274602:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263808 00000100:00100000:0.0:1787118888.274643:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263680 00000100:00100000:0.0:1787118888.274647:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263680 00000100:00100000:0.0:1787118888.274660:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263552 00000100:00100000:0.0:1787118888.274662:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263552 00000100:00100000:0.0:1787118888.274675:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118888.274683:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566263808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118888.274753:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566263808:12345-0@lo:400:kworker.0 Request processed in 70us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118888.274760:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118888.274774:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787118888.274781:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566263680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118888.274813:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566263680:12345-0@lo:400:kworker.0 Request processed in 33us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118888.274819:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787118888.274831:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118888.274836:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566263552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118888.274874:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566263552:12345-0@lo:400:kworker.0 Request processed in 38us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118888.274880:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787118888.274950:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787118888.274976:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137a767480 x1873929566263552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118888.274989:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566263552:0@lo:400:kworker.0 00010000:00080000:0.0:1787118888.275000:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137a764700 x1873929566263680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118888.275009:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566263680:0@lo:400:kworker.0 00010000:00080000:0.0:1787118888.275040:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137a767800 x1873929566263808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787118904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118888.275050:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566263808:0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.275149:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263296 00000100:00100000:3.0:1787118888.275154:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263296 00000100:00100000:3.0:1787118888.275186:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263424 00000100:00100000:3.0:1787118888.275189:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263424 00000100:00100000:3.0:1787118888.275199:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787118888.275205:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566263296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118888.275239:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566263296:12345-0@lo:400:kworker.0 Request processed in 34us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118888.275255:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787118888.275267:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118888.275271:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1873929566263424:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787118888.275293:0:15121:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1787118888.275322:0:15121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa534e3c784f9835 00002000:00100000:3.0:1787118888.275336:0:15121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96137a3d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113903 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787118888.275340:0:15121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787118888.275343:0:15121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787118888.275860:0:15121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787118888.275884:0:15121:0:(import.c:65:import_set_state_nolock()) ffff96137a3d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787118888.275930:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1873929566263424:12345-0@lo:8:kworker.0 Request processed in 657us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118888.275937:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787118888.276399:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566263296:0@lo:400:kworker.0 00000100:00080000:0.0:1787118888.276417:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787118888.276508:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96137a766300 x1873929566263424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787118913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787118888.276522:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787118888.276530:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787118888.276743:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787118888.276747:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9613500c3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787118888.276767:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787118888.276773:0:3297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1873929566263424:0@lo:8:kworker.0 00000004:00080000:0.0:1787118888.276793:0:14459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787118888.277305:0:14459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 467434581853ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787118888.279275:0:14460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787118888.279304:0:14460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14460:1873929566264064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787118888.279375:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118888.279406:0:14460:0:(client.c:2702:ptlrpc_set_wait()) set ffff96124121a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787118888.279496:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264064 00000100:00100000:3.0:1787118888.279502:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264064 00000100:00100000:3.0:1787118888.279962:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787118888.279973:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14460:x1873929566264064:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787118888.281216:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566263936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787118888.281280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787118888.281322:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787118888.281336:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566263936 00000100:00100000:0.0:1787118888.281340:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566263936 00000100:00100000:0.0:1787118888.281374:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787118888.281381:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566263936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118888.281407:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118888.291841:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873929566263936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10453us (10553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118888.291856:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787118888.291908:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961241399500 x1873929566263936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787118904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787118888.291931:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566263936:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787118888.296370:0:15121:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787118888.296381:0:15121:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787118888.296387:0:15121:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1787118888.327996:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.328009:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328026:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.328031:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.328037:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328210:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328223:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328231:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328271:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.328283:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.328289:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328297:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.328301:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328310:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328327:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328335:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f983c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.328350:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.328352:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.328353:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.330436:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.330447:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.330463:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.330472:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.330479:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.330494:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.330504:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.330512:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.330530:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118888.331227:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118888.331237:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.331257:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118888.331261:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.331271:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.331306:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.331314:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f9843 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.331336:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.331338:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.331340:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.333018:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.333030:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.333044:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.333049:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.334636:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.334659:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.334671:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.334686:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.334733:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118888.335337:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118888.335351:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.335360:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.335365:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.335375:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.335397:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.335403:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f984a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.335421:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.335423:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.335424:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.336960:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.336972:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.336986:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.336991:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.336997:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.337008:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.337018:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.337024:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.337050:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787118888.337123:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787118888.337130:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.337139:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118888.337143:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.337152:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.337168:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.337176:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.337178:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.337180:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.337280:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f9851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118888.339278:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.339289:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.339305:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.339309:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.339315:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.339329:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.339338:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.339346:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.339928:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787118888.341025:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.341034:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.341048:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.341052:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.341065:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.341078:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.341087:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.341094:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341893:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787118888.341901:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341911:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.341916:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341938:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341955:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341962:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a489a8/0xaa534e3c784f9858 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341983:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118888.341987:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.341993:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.341996:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.342003:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.342011:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.342018:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.342019:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.342026:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.342307:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.342313:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f985f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.342342:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.344739:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.344751:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344767:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.344771:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.344776:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344789:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344807:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344815:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344836:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.344851:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.344858:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344865:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.344870:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344879:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344895:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344902:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044633c1c/0xaa534e3c784f9866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.344920:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.344928:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.344930:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.348355:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.348367:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348384:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.348388:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.348394:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348407:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348417:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348424:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348451:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.348467:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.348472:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348480:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.348484:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348514:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.348531:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.350022:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fedac10/0xaa534e3c784f986d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.350045:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.350047:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.350049:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.352234:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.352266:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352283:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.352288:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.352294:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352308:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352318:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352334:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352354:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.352368:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.352373:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352382:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.352386:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352394:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352411:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352419:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b43b75d7/0xaa534e3c784f9874 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.352436:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.352438:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.352440:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.355620:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.355641:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355658:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.355662:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.355669:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355683:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355694:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355702:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355960:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.355972:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.355978:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355986:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.355990:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.355999:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.356020:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.356027:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d2cf8a/0xaa534e3c784f987b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.356044:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.356046:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.356048:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.358338:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.358349:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358364:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.358369:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.358375:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358388:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358397:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358405:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358434:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.358446:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.358452:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358460:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.358465:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358473:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358489:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358496:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49b7322/0xaa534e3c784f9882 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.358516:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.358518:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.358519:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787118888.360206:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787118888.360423:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.360432:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.360455:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.360459:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.360465:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.360477:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.360485:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.360491:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.360615:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787118888.361069:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.361075:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.361084:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.361087:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.361092:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.361101:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.361132:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.361139:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361328:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787118888.361335:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361344:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.361348:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361357:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361376:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361384:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a801270a/0xaa534e3c784f9889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361404:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.361408:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361414:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.361417:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361424:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361445:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361453:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.361454:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.361456:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.361526:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.361531:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6ac7fd/0xaa534e3c784f9890 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.361603:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.362336:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.362344:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362354:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.362357:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.362362:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362373:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362381:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362396:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362450:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787118888.362894:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.362900:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362910:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.362913:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.362917:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362925:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362932:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.362938:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363148:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787118888.363154:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363161:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.363165:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363173:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363187:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363194:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d0514ce/0xaa534e3c784f9897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363209:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.363212:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363226:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.363229:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363235:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363257:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.363264:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.363265:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.363267:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.363379:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.363385:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ed2bfc/0xaa534e3c784f989e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118888.363945:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.363951:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.363960:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.363964:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.363969:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.363978:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.363986:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.363992:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.364230:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.364235:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.364253:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340030c00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.364256:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.364265:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.364278:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118888.364424:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.364427:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118888.364429:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.364463:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.364468:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9130121/0xaa534e3c784f98a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118888.364931:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.364937:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.364957:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.364961:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.364965:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.364975:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.364982:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.364989:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.365008:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118888.365929:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118888.365937:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.365959:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961340031e00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.365964:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.365994:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.366011:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.366037:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.366045:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9378449/0xaa534e3c784f98ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.366079:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.366081:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.366083:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.368441:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.368453:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.368468:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.368473:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.368480:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.368493:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.368515:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.368523:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.369933:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.369950:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.369957:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.369968:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.369973:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.369983:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370000:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370008:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dcafa08/0xaa534e3c784f98b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370028:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.370035:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.370037:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.370857:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.370865:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370877:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.370881:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.370886:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370898:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370906:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370913:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.370926:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787118888.371925:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.371933:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.371943:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.371946:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.371950:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.371967:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.371975:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.371981:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.371999:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787118888.372011:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787118888.372016:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372023:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961382042400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.372027:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372036:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372050:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372058:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c73439f6/0xaa534e3c784f98ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372080:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.372083:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372090:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8ca00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.372093:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372100:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.372774:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.372790:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372800:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003708e116/0xaa534e3c784f98c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.372819:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.372821:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.372823:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.373437:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.373443:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.373454:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.373458:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.373470:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.373483:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.373492:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.373499:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.373526:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787118888.373901:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118888.373907:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.373916:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.373921:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.373935:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.373950:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.373957:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049cdf4b0/0xaa534e3c784f98c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.373974:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.373975:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.373977:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.374945:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.374953:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.374965:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.374969:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.374974:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.374985:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.374994:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375011:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375036:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118888.375206:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.375213:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.375221:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8da00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.375225:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.375234:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.375258:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.375266:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7a2e81/0xaa534e3c784f98cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.375282:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.375283:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.375285:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.375877:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.375883:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375893:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.375897:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.375901:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375910:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375917:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375924:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.375940:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787118888.376010:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.376015:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.376022:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.376032:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.376040:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.376052:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.376060:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a3fb184/0xaa534e3c784f98d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.376076:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.376078:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.376080:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.376649:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.376656:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376669:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.376672:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.376676:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376685:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376691:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376698:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376789:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787118888.376801:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118888.376805:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376813:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8cc00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118888.376816:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376823:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376848:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376856:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8138f27/0xaa534e3c784f98dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.376871:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.376873:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.376875:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.377407:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.377413:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.377422:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.377425:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.377430:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.377439:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.377447:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.377455:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.377521:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787118888.378036:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.378043:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.378051:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.378054:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.378058:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.378067:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.378075:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.378082:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381561:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787118888.381575:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381590:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.381595:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381606:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381627:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381645:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007da4da49/0xaa534e3c784f98e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381669:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.381673:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381679:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.381682:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381690:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381701:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.381817:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.381819:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.381821:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.382702:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.384691:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0493f8/0xaa534e3c784f98eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787118888.385374:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.385382:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.385402:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.385407:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.385414:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.385427:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.385437:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.385444:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.387903:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118888.387921:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.387935:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118888.387949:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.387960:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.387981:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118888.387993:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.387995:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118888.387997:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118888.389448:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787118888.389460:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007277768b/0xaa534e3c784f98f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.390971:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787118888.391288:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787118888.391297:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.391312:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1787118888.391318:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118888.391325:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.391351:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.391361:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.391368:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118888.391392:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787118888.391698:0:15121:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:1.0:1787118888.391801:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787118888.391809:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.391818:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:1.0:1787118888.391822:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.391831:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.391849:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.391869:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050bf0e44/0xaa534e3c784f98f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118888.391889:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.391891:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118888.391892:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118888.392050:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14460:x1873929566264064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112076us (112672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118888.392060:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787118888.397018:0:14460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14460:1873929566264064:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787118888.397036:0:14460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787118888.397087:0:14460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14460:1873929566264192:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787118888.397829:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118888.397884:0:14460:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787118888.397907:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264192 00000100:00100000:1.0:1787118888.397913:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264192 00000100:00100000:1.0:1787118888.397957:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787118888.397965:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1873929566264192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787118888.398007:0:15119:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787118888.409771:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14460:x1873929566264192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11798us (11935us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787118888.409784:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787118888.410652:0:14460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14460:1873929566264192:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787118888.410670:0:14460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787118888.777858:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787118888.777883:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566264320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118888.777952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118888.778030:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264320 00000100:00100000:0.0:1787118888.778037:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264320 00000100:00100000:0.0:1787118888.778080:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118888.778089:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566264320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787118888.778123:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118888.778168:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566264320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118888.778175:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787118888.778234:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566264320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787118889.098438:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787118889.890400:0:16196:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg310-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787118890.121957:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118891.153843:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118892.173289:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118892.388365:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.388440:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246272 00000100:00100000:1.0:1787118892.388451:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246272 00000100:00100000:1.0:1787118892.388497:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00100000:1.0:1787118892.388506:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2367:x1873929544246272:12345-192.168.203.10@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787118892.388550:0:14428:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 6a8e9cef-a94a-40b4-b113-4311317b3988@192.168.203.10@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787118892.388577:0:14428:0:(genops.c:1406:class_connect()) connect: client 6a8e9cef-a94a-40b4-b113-4311317b3988, cookie 0xaa534e3c784f9900 00000100:00080000:1.0:1787118892.388710:0:14428:0:(import.c:65:import_set_state_nolock()) ffff961241e33800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118892.388818:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+5:2367:x1873929544246272:12345-192.168.203.10@tcp:250:mount.lustre.0 Request processed in 311us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.388826:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 74 00000100:00100000:3.0:1787118892.410189:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.410302:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246400 00000100:00100000:2.0:1787118892.410311:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246400 00000100:00100000:2.0:1787118892.410364:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 75 00000100:00100000:2.0:1787118892.410373:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+5:13780:x1873929544246400:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787118892.410391:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118892.410407:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986600/0xaa534e3c784f9907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bce5 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.410435:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986600/0xaa534e3c784f9907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bce5 expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.410446:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986600/0xaa534e3c784f9907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bce5 expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.410474:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986600, rc 0) 00000100:00100000:2.0:1787118892.410533:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+6:13780:x1873929544246400:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.410540:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 75 00000100:00100000:3.0:1787118892.422104:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.422322:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246528 00000100:00100000:2.0:1787118892.422332:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246528 00000100:00100000:2.0:1787118892.422398:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:2.0:1787118892.422408:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+6:13780:x1873929544246528:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787118892.422718:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+6:13780:x1873929544246528:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 310us (623us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787118892.422765:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 76 00000100:00100000:3.0:1787118892.427073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.433347:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246656 00000100:00100000:1.0:1787118892.433362:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246656 00000100:00100000:1.0:1787118892.433434:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:1.0:1787118892.433444:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+6:13780:x1873929544246656:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787118892.433459:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118892.433475:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f990e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bcec expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.433503:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f990e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcec expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.433513:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9200/0xaa534e3c784f990e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bcec expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.433523:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9200, rc 0) 00000100:00100000:1.0:1787118892.433653:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+7:13780:x1873929544246656:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 210us (6588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.433660:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 77 00000100:00100000:3.0:1787118892.446238:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118892.446706:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246784 00000100:00100000:0.0:1787118892.446716:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246784 00000100:00100000:0.0:1787118892.446804:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 78 00000100:00100000:0.0:1787118892.446813:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+7:13780:x1873929544246784:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787118892.447123:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13780:x1873929544246784:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 309us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118892.447131:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 78 00000100:00100000:0.0:1787118892.457194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118892.463403:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544246912 00000100:00100000:3.0:1787118892.463417:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544246912 00000100:00100000:3.0:1787118892.463469:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:3.0:1787118892.463479:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13780:x1873929544246912:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787118892.464228:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13780:x1873929544246912:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 747us (7040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118892.464249:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 79 00000100:00100000:3.0:1787118892.469095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.469389:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247040 00000100:00100000:1.0:1787118892.469399:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247040 00000100:00100000:1.0:1787118892.469443:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 80 00000100:00100000:1.0:1787118892.469465:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13799:x1873929544247040:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787118892.470316:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13799:x1873929544247040:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 848us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.470327:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 80 00000100:00100000:3.0:1787118892.487871:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118892.488655:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247168 00000100:00100000:0.0:1787118892.488664:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247168 00000100:00100000:0.0:1787118892.488761:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:0.0:1787118892.488778:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13799:x1873929544247168:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787118892.489244:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13799:x1873929544247168:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 471us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118892.489253:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 81 00000100:00100000:0.0:1787118892.501165:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.501414:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247296 00000100:00100000:1.0:1787118892.501424:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247296 00000100:00100000:1.0:1787118892.501474:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:1.0:1787118892.501482:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+8:13780:x1873929544247296:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787118892.501499:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118892.501516:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f9915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd16 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.501542:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f9915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd16 expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.501553:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9a00/0xaa534e3c784f9915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd16 expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.501563:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9a00, rc 0) 00000100:00100000:1.0:1787118892.501624:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+9:13780:x1873929544247296:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 141us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.501630:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 82 00000100:00100000:1.0:1787118892.508406:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118892.508483:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247424 00000100:00100000:3.0:1787118892.508492:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247424 00000100:00100000:3.0:1787118892.508539:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 83 00000100:00100000:3.0:1787118892.508548:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+9:13780:x1873929544247424:12345-192.168.203.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787118892.508571:0:14429:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787118892.508593:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787118892.508597:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787118892.508600:0:14429:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787118892.508602:0:14429:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787118892.512990:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a0b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+9:13780:x1873929544247424:12345-192.168.203.10@tcp:256:mount.lustre.0 Request processed in 4432us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.513005:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 83 00000100:00100000:0.0:1787118892.516364:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.516448:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247552 00000100:00100000:2.0:1787118892.516457:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247552 00000100:00100000:2.0:1787118892.516510:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 84 00000100:00100000:2.0:1787118892.516520:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+9:13780:x1873929544247552:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787118892.516536:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118892.516552:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd1d expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.516580:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.516609:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118892.516619:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118892.516930:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13780:x1873929544247552:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 410us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.516937:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 84 00000100:00100000:1.0:1787118892.531069:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.531380:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247680 00000100:00100000:2.0:1787118892.531391:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247680 00000100:00100000:2.0:1787118892.531448:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:2.0:1787118892.531458:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13780:x1873929544247680:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787118892.531860:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13780:x1873929544247680:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 402us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.531870:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 85 00000100:00100000:2.0:1787118892.542644:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118892.544874:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247808 00000100:00100000:0.0:1787118892.544892:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247808 00000100:00100000:0.0:1787118892.544968:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:0.0:1787118892.544979:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96134778c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13780:x1873929544247808:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787118892.545282:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96134778c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13780:x1873929544247808:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 303us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118892.545290:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 86 00000100:00100000:1.0:1787118892.549681:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118892.551627:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544247936 00000100:00100000:3.0:1787118892.551644:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544247936 00000100:00100000:2.0:1787118892.552702:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00100000:2.0:1787118892.552717:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13804:x1873929544247936:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787118892.553032:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13804:x1873929544247936:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 317us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.553040:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 87 00000100:00100000:1.0:1787118892.559435:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118892.560039:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248064 00000100:00100000:3.0:1787118892.560048:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248064 00000100:00100000:3.0:1787118892.560104:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:3.0:1787118892.560113:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13804:x1873929544248064:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118892.560791:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13804:x1873929544248064:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 676us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118892.560801:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 88 00000100:00100000:1.0:1787118892.567371:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118892.567487:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248192 00000100:00100000:0.0:1787118892.567504:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248192 00000100:00100000:0.0:1787118892.567592:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:0.0:1787118892.567603:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2367:x1873929544248192:12345-192.168.203.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787118892.567641:0:14436:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 0ebfb404-33ae-4822-8fe6-8d76ee4076d4@192.168.203.10@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1787118892.567788:0:14436:0:(genops.c:1406:class_connect()) connect: client 0ebfb404-33ae-4822-8fe6-8d76ee4076d4, cookie 0xaa534e3c784f9923 00000004:00100000:0.0:1787118892.567832:0:14436:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787118892.567839:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787118892.622371:0:14436:0:(import.c:65:import_set_state_nolock()) ffff961241e30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118892.622543:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2367:x1873929544248192:12345-192.168.203.10@tcp:38:mount.lustre.0 Request processed in 54937us (55176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.622563:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:1.0:1787118892.627430:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.627482:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.627588:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248448 00000100:00100000:2.0:1787118892.627601:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248448 00000100:00100000:2.0:1787118892.627698:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248320 00000100:00100000:2.0:1787118892.627702:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248320 00000100:00100000:2.0:1787118892.627752:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:2.0:1787118892.627782:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:13780:x1873929544248448:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787118892.627843:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118892.628350:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:13780:x1873929544248448:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 561us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.628362:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:2.0:1787118892.628397:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:2.0:1787118892.628407:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:0:x1873929544248320:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787118892.628434:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118892.628458:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:0:x1873929544248320:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 54us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118892.628466:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00080000:3.0:1787118892.628565:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118892.631920:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118892.632045:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248576 00000100:00100000:0.0:1787118892.632073:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248576 00000100:00100000:0.0:1787118892.632153:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:0.0:1787118892.632165:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:13780:x1873929544248576:12345-192.168.203.10@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787118892.632295:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:13780:x1873929544248576:12345-192.168.203.10@tcp:40:mount.lustre.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118892.632309:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:2.0:1787118892.634766:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.634809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118892.634850:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.635060:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248704 00000100:00100000:1.0:1787118892.635071:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248704 00000100:00100000:1.0:1787118892.635129:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248832 00000100:00100000:1.0:1787118892.635133:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248832 00000100:00100000:1.0:1787118892.635149:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:1.0:1787118892.635158:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544248704:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787118892.635198:0:15118:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 0ebfb404-33ae-4822-8fe6-8d76ee4076d4@192.168.203.10@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787118892.635248:0:15118:0:(genops.c:1406:class_connect()) connect: client 0ebfb404-33ae-4822-8fe6-8d76ee4076d4, cookie 0xaa534e3c784f992a 00002000:00100000:1.0:1787118892.635265:0:15118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ebfb404-33ae-4822-8fe6-8d76ee4076d4/ffff961241e36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787118892.635296:0:15118:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787118892.635708:0:15118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787118892.635787:0:15118:0:(import.c:65:import_set_state_nolock()) ffff961241e34800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118892.635879:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2367:x1873929544248704:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 720us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.635888:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:1.0:1787118892.635912:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:1.0:1787118892.635917:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544248832:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787118892.635936:0:15118:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 0ebfb404-33ae-4822-8fe6-8d76ee4076d4@192.168.203.10@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787118892.635957:0:15118:0:(genops.c:1406:class_connect()) connect: client 0ebfb404-33ae-4822-8fe6-8d76ee4076d4, cookie 0xaa534e3c784f9931 00002000:00100000:1.0:1787118892.635980:0:15118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ebfb404-33ae-4822-8fe6-8d76ee4076d4/ffff961241e33000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787118892.636000:0:15118:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787118892.636153:0:15118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787118892.636169:0:15118:0:(import.c:65:import_set_state_nolock()) ffff961241e34000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118892.636193:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2367:x1873929544248832:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 274us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.636201:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118892.637808:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544248960 00000100:00100000:0.0:1787118892.637824:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544248960 00000100:00100000:0.0:1787118892.637889:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:0.0:1787118892.637901:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:13780:x1873929544248960:12345-192.168.203.10@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787118892.639888:0:14438:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1901us 00000004:00200000:0.0:1787118892.655526:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787118892.655775:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:13780:x1873929544248960:12345-192.168.203.10@tcp:33:mount.lustre.0 Request processed in 17868us (20956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118892.655789:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:2.0:1787118892.837452:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118892.837584:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249088 00000100:00100000:1.0:1787118892.837597:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249088 00000100:00100000:1.0:1787118892.837676:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:1.0:1787118892.837688:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:13825:x1873929544249088:12345-192.168.203.10@tcp:101:mkdir.0 00010000:00010000:1.0:1787118892.837714:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118892.837777:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8400/0xaa534e3c784f9938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.837863:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.837880:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.837923:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118892.838217:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787118892.838222:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118892.838331:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.838374:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8400/0xaa534e3c784f9938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd47 expref: 8 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.838393:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd47 expref: 7 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118892.838402:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118892.838405:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787118892.838409:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9600, rc 0) 00000100:00100000:1.0:1787118892.838486:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:13825:x1873929544249088:12345-192.168.203.10@tcp:101:mkdir.0 Request processed in 800us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118892.838495:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00010000:00010000:1.0:1787118893.194279:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118893.386117:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566264448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118893.386226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118893.386376:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264448 00000100:00100000:0.0:1787118893.386388:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264448 00000100:00100000:0.0:1787118893.386470:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787118893.386482:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566264448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118893.386511:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118893.386563:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873929566264448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118893.386570:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787118893.386781:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566264704:0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.386848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118893.386876:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787118893.386882:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566264576:0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.386909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118893.386935:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566265088:0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.386964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118893.386996:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264704 00000100:00100000:1.0:1787118893.387000:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264704 00000100:00100000:1.0:1787118893.387036:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787118893.387044:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566264704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.387083:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566264704:12345-0@lo:400:kworker.0 Request processed in 39us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118893.387097:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787118893.387119:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264576 00000100:00100000:1.0:1787118893.387124:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264576 00000100:00100000:1.0:1787118893.387146:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787118893.387153:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3301:x1873929566264576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.387184:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3301:x1873929566264576:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118893.387191:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787118893.387232:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265088 00000100:00100000:1.0:1787118893.387236:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265088 00000100:00100000:1.0:1787118893.387265:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118893.387273:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566265088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.387304:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566265088:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118893.387310:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118893.387354:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566264576:0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.387370:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566265088:0@lo:400:kworker.0 00000100:00100000:1.0:1787118893.387380:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566264704:0@lo:400:kworker.0 00000100:00080000:2.0:1787118893.387622:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787118893.387629:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118893.387632:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118893.387649:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566264960:0@lo:400:kworker.0 00000100:00100000:2.0:1787118893.387700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118893.387779:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566264448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118893.387797:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787118893.387813:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566264832:0@lo:400:kworker.0 00000100:00100000:2.0:1787118893.387841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118893.387916:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264960 00000100:00100000:0.0:1787118893.387922:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264960 00000100:00100000:0.0:1787118893.387960:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566264832 00000100:00100000:0.0:1787118893.387969:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566264832 00000100:00100000:0.0:1787118893.387990:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118893.387997:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566264960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118893.388042:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873929566264960:12345-0@lo:400:kworker.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118893.388049:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787118893.388061:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787118893.388067:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118893.388091:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873929566264832:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118893.388096:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787118893.388270:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118893.388293:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873929566264832:0@lo:400:kworker.0 00000100:00100000:2.0:1787118893.388303:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961375cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1873929566264960:0@lo:400:kworker.0 00000001:00100000:3.0:1787118893.508383:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ebfb404-33ae-4822-8fe6-8d76ee4076d4 00000001:00080000:3.0:1787118893.508413:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787118893.508464:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787118893.898668:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566265216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118893.898803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118893.900693:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265216 00000100:00100000:3.0:1787118893.900746:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265216 00000100:00100000:3.0:1787118893.900833:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118893.900846:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566265216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118893.900896:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118893.901004:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566265216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118893.901012:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787118893.901445:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566265216:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787118893.966624:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ebfb404-33ae-4822-8fe6-8d76ee4076d4 00010000:00010000:0.0:1787118894.218179:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118894.922179:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118894.922314:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249216 00000100:00100000:2.0:1787118894.922337:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249216 00000100:00100000:2.0:1787118894.922432:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:2.0:1787118894.922446:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:13877:x1873929544249216:12345-192.168.203.10@tcp:41:lfs.0 00000004:00000024:2.0:1787118894.922503:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118894.922634:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:13877:x1873929544249216:12345-192.168.203.10@tcp:41:lfs.0 Request processed in 190us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118894.922644:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00080000:3.0:1787118894.922748:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118894.925886:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118894.925995:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249344 00000100:00100000:3.0:1787118894.926007:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249344 00000100:00100000:3.0:1787118894.926097:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:3.0:1787118894.926111:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:13877:x1873929544249344:12345-192.168.203.10@tcp:13:lfs.0 00002000:00000024:3.0:1787118894.926146:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118894.926266:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:13877:x1873929544249344:12345-192.168.203.10@tcp:13:lfs.0 Request processed in 158us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118894.926275:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00080000:2.0:1787118894.926676:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787118894.928247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118894.928348:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249472 00000100:00100000:3.0:1787118894.928359:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249472 00000100:00100000:3.0:1787118894.928435:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:3.0:1787118894.928449:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:13877:x1873929544249472:12345-192.168.203.10@tcp:13:lfs.0 00002000:00000024:3.0:1787118894.928494:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787118894.928670:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118894.928865:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:13877:x1873929544249472:12345-192.168.203.10@tcp:13:lfs.0 Request processed in 419us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118894.928874:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:1.0:1787118895.167112:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.167302:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249600 00000100:00100000:2.0:1787118895.167315:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249600 00000100:00100000:2.0:1787118895.167388:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 90 00000100:00100000:2.0:1787118895.167400:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+10:13910:x1873929544249600:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787118895.167424:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118895.167450:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986800/0xaa534e3c784f9946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd4e expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.167895:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986800/0xaa534e3c784f9946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd4e expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.167932:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986800/0xaa534e3c784f9946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd4e expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.167943:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986800, rc 0) 00000100:00100000:2.0:1787118895.168153:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544249600:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 755us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.168162:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 90 00000100:00100000:1.0:1787118895.172444:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.172946:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249728 00000100:00100000:2.0:1787118895.172970:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249728 00000100:00100000:2.0:1787118895.173045:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:2.0:1787118895.173057:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544249728:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787118895.173539:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544249728:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 482us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.173550:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 91 00000100:00100000:0.0:1787118895.183396:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.186486:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249856 00000100:00100000:2.0:1787118895.186508:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249856 00000100:00100000:2.0:1787118895.186609:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:2.0:1787118895.186621:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544249856:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787118895.187134:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544249856:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 512us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.187146:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 92 00000100:00100000:3.0:1787118895.202123:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.203776:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544249984 00000100:00100000:1.0:1787118895.203796:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544249984 00000100:00100000:2.0:1787118895.204026:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:2.0:1787118895.204042:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13913:x1873929544249984:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787118895.205845:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f86a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13913:x1873929544249984:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 1792us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118895.205877:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 93 00000100:00100000:1.0:1787118895.228896:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.229225:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250112 00000100:00100000:0.0:1787118895.229240:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250112 00000100:00100000:0.0:1787118895.229315:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 94 00000100:00100000:0.0:1787118895.229327:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13913:x1873929544250112:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787118895.229711:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13913:x1873929544250112:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 384us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.229753:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 94 00010000:00010000:2.0:1787118895.242372:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787118895.251908:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118895.257103:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250240 00000100:00100000:3.0:1787118895.257126:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250240 00000100:00100000:3.0:1787118895.257242:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 95 00000100:00100000:3.0:1787118895.257364:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13910:x1873929544250240:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787118895.257388:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118895.257412:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8d200/0xaa534e3c784f994d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd78 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118895.257451:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8d200/0xaa534e3c784f994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd78 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118895.257464:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8d200/0xaa534e3c784f994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd78 expref: 12 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118895.257476:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8d200, rc 0) 00000100:00100000:3.0:1787118895.257936:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f868050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13910:x1873929544250240:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 575us (6043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118895.257945:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 95 00000100:00100000:1.0:1787118895.269623:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.279131:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250368 00000100:00100000:2.0:1787118895.279463:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250368 00000100:00100000:2.0:1787118895.279565:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:2.0:1787118895.279577:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13910:x1873929544250368:12345-192.168.203.10@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787118895.279613:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787118895.279645:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787118895.279649:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787118895.279653:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787118895.279655:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787118895.289502:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f869050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13910:x1873929544250368:12345-192.168.203.10@tcp:256:mount.lustre.0 Request processed in 9910us (19879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.289522:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 96 00000100:00100000:0.0:1787118895.294329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.294462:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250496 00000100:00100000:1.0:1787118895.294475:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250496 00000100:00100000:1.0:1787118895.294563:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:1.0:1787118895.294575:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13910:x1873929544250496:12345-192.168.203.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787118895.294606:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118895.294629:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bd7f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118895.294667:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118895.294681:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118895.294692:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9000, rc 0) 00000100:00100000:1.0:1787118895.294789:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13910:x1873929544250496:12345-192.168.203.10@tcp:101:mount.lustre.0 Request processed in 217us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118895.294798:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 97 00000100:00100000:1.0:1787118895.298999:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.299102:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250624 00000100:00100000:2.0:1787118895.299115:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250624 00000100:00100000:2.0:1787118895.299185:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 98 00000100:00100000:2.0:1787118895.299210:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13910:x1873929544250624:12345-192.168.203.10@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787118895.299790:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13910:x1873929544250624:12345-192.168.203.10@tcp:501:mount.lustre.0 Request processed in 593us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.299801:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 98 00000100:00100000:0.0:1787118895.313451:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118895.315260:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250752 00000100:00100000:3.0:1787118895.315433:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250752 00000100:00100000:2.0:1787118895.315843:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 99 00000100:00100000:2.0:1787118895.315857:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13910:x1873929544250752:12345-192.168.203.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787118895.316285:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13910:x1873929544250752:12345-192.168.203.10@tcp:503:mount.lustre.0 Request processed in 418us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.316295:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 99 00000100:00100000:0.0:1787118895.322048:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.322512:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544250880 00000100:00100000:1.0:1787118895.322526:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544250880 00000100:00100000:1.0:1787118895.322607:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:1.0:1787118895.322619:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13920:x1873929544250880:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787118895.323047:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13920:x1873929544250880:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 428us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118895.323056:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 100 00000100:00100000:1.0:1787118895.336626:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.336820:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251008 00000100:00100000:2.0:1787118895.336838:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251008 00000100:00100000:2.0:1787118895.336915:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:2.0:1787118895.336932:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13920:x1873929544251008:12345-192.168.203.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787118895.337416:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13920:x1873929544251008:12345-192.168.203.10@tcp:502:llog_process_th.0 Request processed in 487us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.337426:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 101 00000100:00100000:0.0:1787118895.353020:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.353264:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251136 00000100:00100000:1.0:1787118895.353277:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251136 00000100:00100000:1.0:1787118895.353346:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:1.0:1787118895.353356:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2367:x1873929544251136:12345-192.168.203.10@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787118895.353396:0:14435:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from c6e5e66e-017b-467b-b68a-c042fe6d629f@192.168.203.10@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1787118895.353446:0:14435:0:(genops.c:1406:class_connect()) connect: client c6e5e66e-017b-467b-b68a-c042fe6d629f, cookie 0xaa534e3c784f995b 00000004:00100000:1.0:1787118895.353490:0:14435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787118895.353654:0:14435:0:(import.c:65:import_set_state_nolock()) ffff96137a628800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787118895.353816:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2367:x1873929544251136:12345-192.168.203.10@tcp:38:mount.lustre.0 Request processed in 460us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118895.353825:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118895.360859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.360906:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.361234:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251264 00000100:00100000:2.0:1787118895.361247:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251264 00000100:00080000:3.0:1787118895.361428:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118895.361781:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251392 00000100:00100000:1.0:1787118895.361789:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251392 00000100:00100000:2.0:1787118895.361908:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118895.361934:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+7:2368:x1873929544251264:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787118895.361968:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787118895.363261:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.363319:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.363411:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.363475:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251648 00000100:00100000:0.0:1787118895.363483:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251648 00000100:00100000:0.0:1787118895.363539:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251776 00000100:00100000:0.0:1787118895.363543:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251776 00000100:00100000:0.0:1787118895.363564:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:0.0:1787118895.363575:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2368:x1873929544251648:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118895.363674:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2368:x1873929544251648:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 100us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.363682:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:0.0:1787118895.363701:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:0.0:1787118895.363707:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2368:x1873929544251776:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118895.363763:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2368:x1873929544251776:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 55us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.363769:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:3.0:1787118895.364088:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787118895.364100:0:14436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787118895.364773:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251520 00000100:00100000:0.0:1787118895.364780:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251520 00000100:00100000:0.0:1787118895.364822:0:14436:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787118895.364834:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:0.0:1787118895.364861:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2368:x1873929544251520:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118895.364921:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2368:x1873929544251520:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 63us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.364928:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:2.0:1787118895.371207:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+7:2368:x1873929544251264:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 9265us (10342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.371224:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118895.371263:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:2.0:1787118895.371276:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544251392:12345-192.168.203.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787118895.371308:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787118895.371347:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544251392:12345-192.168.203.10@tcp:41:mount.lustre.0 Request processed in 76us (10440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.371354:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:3.0:1787118895.377505:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.377967:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544251904 00000100:00100000:1.0:1787118895.377981:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544251904 00000100:00100000:1.0:1787118895.378103:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:1.0:1787118895.378114:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544251904:12345-192.168.203.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787118895.378229:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544251904:12345-192.168.203.10@tcp:40:mount.lustre.0 Request processed in 116us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118895.378237:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:1.0:1787118895.385550:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.385604:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118895.385689:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118895.385812:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252032 00000100:00100000:0.0:1787118895.385840:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252032 00000100:00100000:0.0:1787118895.385909:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252160 00000100:00100000:0.0:1787118895.385913:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252160 00000100:00100000:0.0:1787118895.385933:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118895.385941:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544252032:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787118895.385975:0:15118:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from c6e5e66e-017b-467b-b68a-c042fe6d629f@192.168.203.10@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1787118895.386009:0:15118:0:(genops.c:1406:class_connect()) connect: client c6e5e66e-017b-467b-b68a-c042fe6d629f, cookie 0xaa534e3c784f9962 00002000:00100000:0.0:1787118895.386029:0:15118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6e5e66e-017b-467b-b68a-c042fe6d629f/ffff96137f889800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787118895.386040:0:15118:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787118895.386318:0:15118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787118895.386350:0:15118:0:(import.c:65:import_set_state_nolock()) ffff96137f88e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118895.386415:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2367:x1873929544252032:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 472us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.386425:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:0.0:1787118895.386443:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:0.0:1787118895.386448:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1873929544252160:12345-192.168.203.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787118895.386463:0:15118:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from c6e5e66e-017b-467b-b68a-c042fe6d629f@192.168.203.10@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1787118895.386479:0:15118:0:(genops.c:1406:class_connect()) connect: client c6e5e66e-017b-467b-b68a-c042fe6d629f, cookie 0xaa534e3c784f9969 00002000:00100000:0.0:1787118895.386484:0:15118:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6e5e66e-017b-467b-b68a-c042fe6d629f/ffff96136e5c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113903 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787118895.386504:0:15118:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787118895.386671:0:15118:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787118895.386688:0:15118:0:(import.c:65:import_set_state_nolock()) ffff96136e5c4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787118895.387152:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2367:x1873929544252160:12345-192.168.203.10@tcp:8:mount.lustre.0 Request processed in 701us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118895.387162:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118895.387262:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252288 00000100:00100000:2.0:1787118895.387268:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252288 00000100:00100000:2.0:1787118895.387309:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:2.0:1787118895.387316:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544252288:12345-192.168.203.10@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787118895.387539:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787118895.387830:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13910:x1873929544252288:12345-192.168.203.10@tcp:33:mount.lustre.0 Request processed in 513us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.387838:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00000040:00080000:3.0:1787118895.564412:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787118895.596160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118895.597634:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252416 00000100:00100000:2.0:1787118895.597650:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252416 00000100:00100000:2.0:1787118895.597736:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:2.0:1787118895.597749:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:13941:x1873929544252416:12345-192.168.203.10@tcp:101:mkdir.0 00010000:00010000:2.0:1787118895.597778:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118895.597804:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bda9 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.597867:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.597881:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.597903:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118895.598102:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787118895.598107:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118895.598185:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.598222:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 8 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.598238:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118895.598259:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:2.0:1787118895.598261:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118895.598265:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118895.598336:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+7:13941:x1873929544252416:12345-192.168.203.10@tcp:101:mkdir.0 Request processed in 590us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118895.598343:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00010000:00010000:1.0:1787118896.266097:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118897.294619:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787118898.129926:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6e5e66e-017b-467b-b68a-c042fe6d629f 00000001:00100000:3.0:1787118898.129952:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ebfb404-33ae-4822-8fe6-8d76ee4076d4 00010000:00010000:1.0:1787118898.314932:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118898.506590:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566265344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118898.506703:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118898.506887:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265344 00000100:00100000:0.0:1787118898.506896:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265344 00000100:00100000:0.0:1787118898.506969:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787118898.506981:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566265344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118898.507025:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787118898.507092:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566265344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118898.507101:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787118898.507312:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118898.507343:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787118898.507371:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566265344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787118898.520280:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566265472:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118898.520467:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265472 00000100:00100000:3.0:1787118898.520476:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265472 00000100:00100000:3.0:1787118898.520531:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787118898.520541:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3299:x1873929566265472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520601:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3299:x1873929566265472:12345-0@lo:400:kworker.0 Request processed in 60us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118898.520609:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787118898.520667:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a15e2bd8-d402-42e4-a923-f01b19147eee:3299:1873929566265472:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520717:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566265600:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118898.520809:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265600 00000100:00100000:3.0:1787118898.520813:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265600 00000100:00100000:3.0:1787118898.520853:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118898.520860:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566265600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520897:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566265600:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118898.520904:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787118898.520921:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787118898.520940:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566265600:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.520970:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566265728:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.521003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118898.521037:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265728 00000100:00100000:3.0:1787118898.521053:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265728 00000100:00100000:3.0:1787118898.521217:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787118898.521226:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566265728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.521265:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873929566265728:12345-0@lo:400:kworker.0 Request processed in 41us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118898.521272:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787118898.535216:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873929566265728:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.535269:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566265856:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.535380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118898.535426:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118898.535433:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566265984:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.535459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118898.535499:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265856 00000100:00100000:3.0:1787118898.535507:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265856 00000100:00100000:3.0:1787118898.535564:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566265984 00000100:00100000:3.0:1787118898.535567:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566265984 00000100:00100000:3.0:1787118898.535594:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787118898.535604:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566265856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118898.535756:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118898.535767:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566265984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118898.535811:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1873929566265984:12345-0@lo:400:kworker.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118898.535819:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787118898.535911:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566265856:12345-0@lo:400:kworker.0 Request processed in 308us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118898.535919:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787118898.535936:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118898.535963:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1873929566265984:0@lo:400:kworker.0 00000100:00100000:3.0:1787118898.535972:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566265856:0@lo:400:kworker.0 00000001:00100000:2.0:1787118898.585827:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6e5e66e-017b-467b-b68a-c042fe6d629f 00000001:02000400:0.0:1787118899.007454:0:16402:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787118899.029527:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787118899.029556:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566266112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787118899.029656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118899.029768:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566266112 00000100:00100000:2.0:1787118899.029778:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566266112 00000100:00100000:2.0:1787118899.029839:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787118899.029849:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566266112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118899.029910:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118899.029965:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566266112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118899.029972:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787118899.030031:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566266112:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787118899.123054:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6e5e66e-017b-467b-b68a-c042fe6d629f 00010000:00010000:1.0:1787118899.338018:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118900.364681:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118900.439817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439859:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439876:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439938:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439962:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.439987:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118900.440007:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252928 00000100:00100000:1.0:1787118900.440015:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252928 00000100:00100000:1.0:1787118900.440063:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253184 00000100:00100000:1.0:1787118900.440067:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253184 00000100:00100000:1.0:1787118900.440083:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252800 00000100:00100000:1.0:1787118900.440085:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252800 00000100:00100000:1.0:1787118900.440095:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253312 00000100:00100000:1.0:1787118900.440096:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253312 00000100:00100000:1.0:1787118900.440111:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:1.0:1787118900.440120:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544252928:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118900.440200:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544252928:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118900.440208:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:2.0:1787118900.440220:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252672 00000100:00100000:2.0:1787118900.440228:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252672 00000100:00100000:1.0:1787118900.440232:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:1.0:1787118900.440241:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544253184:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118900.440271:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253056 00000100:00100000:1.0:1787118900.440271:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544253184:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118900.440277:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253056 00000100:00100000:1.0:1787118900.440282:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:1.0:1787118900.440299:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:1.0:1787118900.440307:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544252800:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118900.440313:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118900.440324:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2369:x1873929544252672:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118900.440361:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544252800:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 54us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118900.440368:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118900.440375:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2369:x1873929544252672:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118900.440383:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:2.0:1787118900.440387:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:1.0:1787118900.440396:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544253312:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118900.440409:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118900.440419:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2369:x1873929544253056:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118900.440425:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544253312:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118900.440432:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:2.0:1787118900.440454:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2369:x1873929544253056:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00080000:1.0:1787118900.440455:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787118900.440462:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118900.440465:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787118900.440466:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118900.440492:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544252544 00000100:00100000:2.0:1787118900.440496:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544252544 00000100:00100000:2.0:1787118900.440530:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 103 00000100:00100000:2.0:1787118900.440538:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2369:x1873929544252544:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118900.440567:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2369:x1873929544252544:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118900.440581:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 103 00010000:00010000:1.0:1787118901.397181:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787118902.410258:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787118903.065317:0:16551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe42f92e40 20000000:00000080:3.0:1787118903.065333:0:16551:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961243869000 uarg=0000000000000000 20000000:01000000:3.0:1787118903.067206:0:16551:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787118903.067214:0:16551:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787118903.067220:0:16551:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787118903.074117:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787118903.074288:0:16551:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787118903.087372:0:16551:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787118903.087429:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087448:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f966e expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087455:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087461:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087471:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087479:0:16551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087486:0:16551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087527:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087543:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118903.087573:0:16551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266240:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118903.087841:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087850:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 12 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118903.087859:0:16551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266368:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118903.087895:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087903:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 18 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118903.087912:0:16551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266496:0@lo:104: 00000100:00100000:3.0:1787118903.087951:0:16551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118903.087986:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.087994:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 18 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118903.088002:0:16551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266624:0@lo:104: 00000100:00100000:3.0:1787118903.088020:0:16551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787118903.088037:0:16551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 18 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088044:0:16551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 18 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118903.088059:0:16551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266752:0@lo:104: 00000100:00100000:3.0:1787118903.088078:0:16551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118903.088086:0:16551:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134642c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787118903.088124:0:14419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787118903.088135:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566266496 00000100:00100000:3.0:1787118903.088152:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566266496 00000100:00100000:3.0:1787118903.088182:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566266624 00000100:00100000:3.0:1787118903.088185:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566266624 00000100:00100000:3.0:1787118903.088192:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566266752 00000100:00100000:3.0:1787118903.088194:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566266752 00000100:00100000:3.0:1787118903.088205:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787118903.088213:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+5:16551:x1873929566266496:12345-0@lo:104: 00010000:00010000:3.0:1787118903.088224:0:14419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088265:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787118903.088270:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+5:16551:x1873929566266496:12345-0@lo:104: Request processed in 58us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118903.088277:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787118903.088293:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118903.088298:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+4:16551:x1873929566266624:12345-0@lo:104: 00010000:00010000:3.0:1787118903.088305:0:14419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088335:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787118903.088340:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+4:16551:x1873929566266624:12345-0@lo:104: Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118903.088354:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787118903.088366:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787118903.088372:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613815fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+3:16551:x1873929566266752:12345-0@lo:104: 00010000:00010000:3.0:1787118903.088379:0:14419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088410:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787118903.088415:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613815fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+3:16551:x1873929566266752:12345-0@lo:104: Request processed in 45us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118903.088421:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787118903.088471:0:16551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266496:0@lo:104: 00000100:00100000:3.0:1787118903.088478:0:16551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266624:0@lo:104: 00000100:00100000:3.0:1787118903.088484:0:16551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266752:0@lo:104: 00010000:00010000:3.0:1787118903.088502:0:14424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787118903.088507:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088515:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:3.0:1787118903.088519:0:14424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088527:0:14424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787118903.088535:0:14424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787118903.088550:0:14424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787118903.088573:0:14424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088579:0:14424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787118903.088594:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.088601:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96136eb80c00/0xaa534e3c784f97ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f97f6 expref: -99 pid: 15838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090221:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787118903.090232:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090242:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8c00 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118903.090246:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090254:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118903.090262:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118903.090267:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787118903.090299:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090307:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118903.090333:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090340:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c8c00/0xaa534e3c784f96bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f96c2 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090356:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787118903.090358:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090382:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8800 already unused, calling callback (ffffffffc1af0c20) 10000000:00010000:2.0:1787118903.090385:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090391:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787118903.090397:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787118903.090403:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787118903.090416:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090422:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787118903.090429:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090434:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.110@tcp lock: ffff96137f6c8800/0xaa534e3c784f966e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa534e3c784f9675 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090443:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118903.090444:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787118903.090446:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118903.090474:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566266880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118903.090533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.090592:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566267008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118903.090613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.090639:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787118903.090645:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566267136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118903.090668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.090702:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566266880 00000100:00100000:2.0:1787118903.090709:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566266880 00010000:00010000:2.0:1787118903.090755:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 19 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118903.090781:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267008 00000100:00100000:2.0:1787118903.090785:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267008 00010000:00010000:2.0:1787118903.090796:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 20 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118903.090806:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267136 00000100:00100000:2.0:1787118903.090808:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267136 00010000:00010000:2.0:1787118903.090816:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 21 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118903.090828:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118903.090835:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+21:3301:x1873929566266880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118903.090846:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118903.090852:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 21 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090861:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 21 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090876:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c8600/0xaa534e3c784f97f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f97ef expref: 21 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090888:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118903.090927:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+20:3301:x1873929566266880:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118903.090935:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787118903.090952:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118903.090959:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3298:x1873929566267008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118903.090966:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118903.090971:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 19 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090978:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 19 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090989:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986400/0xaa534e3c784f96c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f96bb expref: 19 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.090997:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118903.091021:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:3298:x1873929566267008:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118903.091027:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787118903.091038:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118903.091044:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:3298:x1873929566267136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787118903.091051:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118903.091055:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 17 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.091062:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 17 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.091072:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961382042200/0xaa534e3c784f9675 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa534e3c784f966e expref: 17 pid: 14429 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.091086:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118903.091107:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:3298:x1873929566267136:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118903.091113:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787118903.091182:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566267136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118903.091191:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566267008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787118903.091213:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a15e2bd8-d402-42e4-a923-f01b19147eee:3301:1873929566266880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787118903.093411:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118903.093751:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118903.093755:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118903.093757:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118903.101565:0:16551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241398e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266240:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118903.101582:0:16551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff961241399c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16551:1873929566266368:192.168.203.10@tcp:104: 00010000:00010000:3.0:1787118903.101621:0:16551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118903.107211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118903.107294:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118903.107372:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253568 00000100:00100000:0.0:1787118903.107382:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253568 00010000:00010000:0.0:1787118903.107418:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 13 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118903.107455:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253440 00000100:00100000:0.0:1787118903.107457:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253440 00010000:00010000:0.0:1787118903.107471:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 14 pid: 14428 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118903.107486:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:0.0:1787118903.107510:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8e9cef-a94a-40b4-b113-4311317b3988+14:2368:x1873929544253568:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118903.107525:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118903.107531:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 14 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107543:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 14 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107560:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96136e986e00/0xaa534e3c784f991c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd1d expref: 14 pid: 14430 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107576:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118903.107637:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2368:x1873929544253568:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 128us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.107646:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:0.0:1787118903.107664:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:0.0:1787118903.107670:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8e9cef-a94a-40b4-b113-4311317b3988+12:2368:x1873929544253440:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118903.107677:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118903.107681:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107690:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107701:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96137f6c9000/0xaa534e3c784f9954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd7f expref: 12 pid: 14428 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107713:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107755:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107781:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107788:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107795:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107801:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107807:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8cc00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118903.107811:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107819:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107831:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118903.107841:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118903.107862:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a8e9cef-a94a-40b4-b113-4311317b3988+11:2368:x1873929544253440:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 192us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.107869:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00010000:00010000:3.0:1787118903.108311:0:16551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.108320:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118903.108326:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f997e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118903.438395:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118903.627929:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566267520:0@lo:400:kworker.0 00000100:00100000:3.0:1787118903.628020:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118903.628094:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787118903.628100:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566267648:0@lo:400:kworker.0 00000100:00100000:3.0:1787118903.628123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118903.628164:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267520 00000100:00100000:3.0:1787118903.628171:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267520 00000100:00100000:3.0:1787118903.628211:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267648 00000100:00100000:3.0:1787118903.628214:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267648 00000100:00100000:3.0:1787118903.628239:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787118903.628246:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566267520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118903.628535:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267392:0@lo:400:kworker.0 00000100:00100000:2.0:1787118903.628572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.628607:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787118903.628634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.628669:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787118903.628677:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267264:0@lo:400:kworker.0 00000100:00100000:2.0:1787118903.628699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118903.628741:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566267776:0@lo:400:kworker.0 00000100:00100000:2.0:1787118903.628778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118903.628790:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267904 00000100:00100000:2.0:1787118903.628804:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267392 00000100:00100000:2.0:1787118903.628809:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267392 00000100:00100000:2.0:1787118903.628842:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267264 00000100:00100000:0.0:1787118903.628847:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267904 00000100:00100000:2.0:1787118903.628848:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267264 00000100:00100000:2.0:1787118903.628876:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787118903.628885:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566267392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118903.628887:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118903.628899:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566267904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787118903.628928:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118903.628937:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873929566267392:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118903.628952:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787118903.628973:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566267904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.628981:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787118903.628985:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787118903.628994:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566267264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118903.629006:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566267776 00000100:00100000:0.0:1787118903.629011:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566267776 00000100:00100000:2.0:1787118903.629030:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566267264:12345-0@lo:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.629036:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787118903.629041:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787118903.629047:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566267648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118903.629091:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566267648:12345-0@lo:400:kworker.0 Request processed in 47us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.629098:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787118903.629112:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787118903.629118:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566267776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118903.629156:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873929566267776:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118903.629162:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787118903.629393:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118903.629399:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787118903.629402:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787118903.629453:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267264:0@lo:400:kworker.0 00000100:00100000:1.0:1787118903.629466:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1873929566267776:0@lo:400:kworker.0 00000100:00100000:1.0:1787118903.629476:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267392:0@lo:400:kworker.0 00000100:00100000:1.0:1787118903.629489:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566267904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118903.629536:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566267648:0@lo:400:kworker.0 00000100:00100000:3.0:1787118903.629881:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566267520:12345-0@lo:400:kworker.0 Request processed in 1634us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118903.629888:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787118903.630251:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566267520:0@lo:400:kworker.0 00000100:00100000:3.0:1787118904.138160:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787118904.138190:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566268032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787118904.138286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118904.138453:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268032 00000100:00100000:2.0:1787118904.138463:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268032 00000100:00100000:2.0:1787118904.138849:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787118904.138860:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566268032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787118904.138905:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787118904.138977:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566268032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118904.138985:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787118904.139069:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566268032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787118904.458018:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118904.731520:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118904.731814:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253696 00000100:00100000:3.0:1787118904.731828:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253696 00000100:00100000:3.0:1787118904.731904:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00100000:3.0:1787118904.731916:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+11:13794:x1873929544253696:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118904.731937:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118904.731961:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8c400/0xaa534e3c784f9985 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdb0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.731995:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8c400/0xaa534e3c784f9985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdb0 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.732010:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8c400/0xaa534e3c784f9985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdb0 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.732035:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c400, rc 0) 00000100:00100000:3.0:1787118904.732102:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544253696:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 187us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118904.732109:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 104 00000100:00100000:1.0:1787118904.745012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118904.745100:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253824 00000100:00100000:3.0:1787118904.745113:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253824 00000100:00100000:3.0:1787118904.745200:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 105 00000100:00100000:3.0:1787118904.745212:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544253824:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.745610:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544253824:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 398us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118904.745619:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 105 00000100:00100000:1.0:1787118904.750538:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118904.750635:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544253952 00000100:00100000:0.0:1787118904.750648:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544253952 00000100:00100000:0.0:1787118904.750748:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00100000:0.0:1787118904.750761:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544253952:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.751054:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544253952:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 294us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.751074:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 106 00000100:00100000:0.0:1787118904.760581:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118904.760960:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254080 00000100:00100000:3.0:1787118904.760974:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254080 00000100:00100000:3.0:1787118904.761041:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118904.761053:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+12:13794:x1873929544254080:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118904.761074:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118904.761097:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f998c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdb7 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.761142:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f998c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdb7 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.761156:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961350e8cc00/0xaa534e3c784f998c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdb7 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.761168:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8cc00, rc 0) 00000100:00100000:3.0:1787118904.761265:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13794:x1873929544254080:12345-192.168.203.10@tcp:101:ll_cfg_requeue.0 Request processed in 213us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118904.761273:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 107 00000100:00100000:3.0:1787118904.771601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118904.771647:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254208 00000100:00100000:3.0:1787118904.771660:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254208 00000100:00100000:3.0:1787118904.771719:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00100000:3.0:1787118904.771754:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13794:x1873929544254208:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.772103:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13794:x1873929544254208:12345-192.168.203.10@tcp:501:ll_cfg_requeue.0 Request processed in 351us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118904.772111:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 108 00000100:00100000:2.0:1787118904.794120:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118904.794587:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254336 00000100:00100000:3.0:1787118904.794895:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254336 00000100:00100000:3.0:1787118904.794972:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 109 00000100:00100000:3.0:1787118904.794984:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13794:x1873929544254336:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.795287:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:13794:x1873929544254336:12345-192.168.203.10@tcp:503:ll_cfg_requeue.0 Request processed in 303us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118904.795299:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 109 10000000:01000000:3.0:1787118904.845877:0:14433:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787118904.845886:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137b485800 from 10 10000000:01000000:3.0:1787118904.845891:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787118904.846004:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.846016:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.846027:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118904.846063:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.846141:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118904.846187:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350ff2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118904.847397:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268160 00000100:00100000:2.0:1787118904.847407:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268160 00000100:00100000:2.0:1787118904.847465:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787118904.847474:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+16:14433:x1873929566268160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787118904.847489:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118904.847504:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136e986e00/0xaa534e3c784f999a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f9993 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118904.847537:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136e986e00/0xaa534e3c784f999a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f9993 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118904.847548:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136e986e00/0xaa534e3c784f999a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f9993 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118904.847566:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986e00, rc 0) 00000100:00100000:2.0:1787118904.847622:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118904.847629:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787118904.847789:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787118904.847806:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f999a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118904.847814:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f999a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118904.847870:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.847898:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118904.847935:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350ff2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787118904.847984:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268288 00000100:00100000:2.0:1787118904.847988:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268288 00000100:00100000:2.0:1787118904.848022:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787118904.848029:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787118904.848254:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118904.848260:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787118904.848429:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.848455:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787118904.848490:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118904.848518:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff961350ff2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787118904.848615:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268416 00000100:00100000:3.0:1787118904.848619:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268416 00000100:00100000:2.0:1787118904.851837:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787118904.851854:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787118904.852679:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 829us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118904.852690:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787118904.853116:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787118904.862777:0:16611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787118904.863368:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787118904.863390:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118904.863401:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f999a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863413:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff961350e8ca00/0xaa534e3c784f9993 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f999a expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118904.863423:0:14433:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787118904.863426:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff961375690800 from 10 10000000:01000000:0.0:1787118904.863429:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118904.863462:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863470:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863481:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118904.863503:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.863567:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.863607:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.863625:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268544 00000100:00100000:0.0:1787118904.863633:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268544 00000100:00100000:0.0:1787118904.863675:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787118904.863684:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+17:14433:x1873929566268544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118904.863708:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118904.863739:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136eb80800/0xaa534e3c784f99a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f99a1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863761:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb80800/0xaa534e3c784f99a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f99a1 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863771:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136eb80800/0xaa534e3c784f99a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f99a1 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863780:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80800, rc 0) 00000100:00100000:0.0:1787118904.863818:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.863825:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787118904.863859:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118904.863873:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99a8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.863881:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f99a8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118904.863927:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.863953:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.863968:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.863981:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268672 00000100:00100000:0.0:1787118904.863984:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268672 00000100:00100000:0.0:1787118904.864011:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787118904.864017:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.864263:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.864270:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787118904.864301:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.864326:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.864363:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.864376:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.864387:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268800 00000100:00100000:0.0:1787118904.864391:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268800 00000100:00100000:0.0:1787118904.864407:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787118904.864413:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.864544:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.864550:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787118904.864585:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787118904.865277:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787118904.865325:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787118904.865339:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787118904.865347:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99a8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865354:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb80e00/0xaa534e3c784f99a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99a8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787118904.865363:0:14433:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787118904.865371:0:14433:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96137863b800 from 10 10000000:01000000:0.0:1787118904.865374:0:14433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787118904.865394:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865401:0:14433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865408:0:14433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118904.865422:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.865450:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.865464:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.865478:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566268928 00000100:00100000:0.0:1787118904.865480:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566268928 00000100:00100000:0.0:1787118904.865502:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787118904.865507:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+18:14433:x1873929566268928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118904.865515:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118904.865523:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96136eb81a00/0xaa534e3c784f99b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa534e3c784f99af expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865538:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96136eb81a00/0xaa534e3c784f99b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa534e3c784f99af expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865546:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96136eb81a00/0xaa534e3c784f99b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa534e3c784f99af expref: 19 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865553:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81a00, rc 0) 00000100:00100000:0.0:1787118904.865577:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566268928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.865588:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787118904.865623:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566268928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787118904.865636:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99b6 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118904.865643:0:14433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa534e3c784f99b6 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118904.865680:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566269056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.865703:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.865714:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.865744:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566269056 00000100:00100000:0.0:1787118904.865748:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566269056 00000100:00100000:0.0:1787118904.865769:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787118904.865775:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566269056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.865944:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566269056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.865950:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787118904.865977:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566269056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.865997:0:14433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566269184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.866029:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787118904.866040:0:14433:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787118904.866051:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566269184 00000100:00100000:0.0:1787118904.866054:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566269184 00000100:00100000:0.0:1787118904.866073:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787118904.866087:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566269184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787118904.872310:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a15e2bd8-d402-42e4-a923-f01b19147eee+19:14433:x1873929566269184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6213us (6270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118904.872325:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787118904.873710:0:14433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a15e2bd8-d402-42e4-a923-f01b19147eee:14433:1873929566269184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787118904.885808:0:16613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787118904.887620:0:14433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787118904.887652:0:14433:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787118904.887663:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99b6 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118904.887676:0:14433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.110@tcp lock: ffff96136eb81e00/0xaa534e3c784f99af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa534e3c784f99b6 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118905.485824:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118905.562399:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118905.562582:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254464 00000100:00100000:2.0:1787118905.562601:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254464 00000100:00100000:2.0:1787118905.562662:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 119 00000100:00100000:2.0:1787118905.562671:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2370:x1873929544254464:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118905.562755:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2370:x1873929544254464:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118905.570574:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118905.572268:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 119 00000100:00100000:3.0:1787118905.573074:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118905.573099:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118905.573119:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118905.573151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118905.575395:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254848 00000100:00100000:1.0:1787118905.575408:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254848 00000100:00100000:1.0:1787118905.575459:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255104 00000100:00100000:1.0:1787118905.575463:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255104 00000100:00100000:1.0:1787118905.575475:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254720 00000100:00100000:1.0:1787118905.575477:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254720 00000100:00100000:1.0:1787118905.575499:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:1.0:1787118905.575509:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2371:x1873929544254848:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118905.575583:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2371:x1873929544254848:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 76us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118905.575591:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:1.0:1787118905.575606:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:1.0:1787118905.575612:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2371:x1873929544255104:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118905.576115:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2371:x1873929544255104:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 432us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118905.576134:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:1.0:1787118905.576151:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:1.0:1787118905.576159:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2371:x1873929544254720:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:1.0:1787118905.576257:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2371:x1873929544254720:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 98us (3135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118905.576277:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00080000:1.0:1787118905.576300:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787118905.576304:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118905.580224:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118905.580269:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255232 00000100:00100000:3.0:1787118905.580278:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255232 00000100:00100000:3.0:1787118905.580336:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118905.580346:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2371:x1873929544255232:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118905.580435:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2371:x1873929544255232:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118905.580443:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00080000:1.0:1787118905.580570:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118905.583108:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254976 00000100:00100000:3.0:1787118905.583120:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254976 00000100:00100000:3.0:1787118905.583204:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:3.0:1787118905.583215:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2371:x1873929544254976:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:3.0:1787118905.583280:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2371:x1873929544254976:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 67us (10127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118905.583287:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00080000:1.0:1787118905.583986:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118905.590611:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544254592 00000100:00100000:2.0:1787118905.590624:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544254592 00000100:00100000:2.0:1787118905.590701:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:2.0:1787118905.590713:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2371:x1873929544254592:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118905.590811:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2371:x1873929544254592:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 100us (20245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118905.590821:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00080000:2.0:1787118905.590846:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787118905.804567:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787118906.506706:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118907.321122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.321529:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255360 00000100:00100000:0.0:1787118907.321540:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255360 00000100:00100000:0.0:1787118907.321615:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:0.0:1787118907.321626:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:14451:x1873929544255360:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118907.321643:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118907.321664:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f99bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdbe expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321758:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321773:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321787:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321801:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321808:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.321815:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.322330:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f99d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.322341:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f99d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.322348:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f99d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118907.324162:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787118907.324170:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118907.324342:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f99d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324358:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324366:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324373:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324379:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118907.324383:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324391:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.324405:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00000100:00080000:2.0:1787118907.325147:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118907.325520:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118907.325530:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325539:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f99c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325556:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325563:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325569:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325574:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118907.325577:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325584:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325595:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96135456f700) 00010000:00010000:0.0:1787118907.325597:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118907.325600:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325605:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f99cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325648:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f99bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdbe expref: 8 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325677:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81800/0xaa534e3c784f99d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdbe expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.325684:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96135456fc00) 00010000:00010000:0.0:1787118907.325686:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118907.325688:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81800, rc 0) 00000100:00100000:0.0:1787118907.325842:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:14451:x1873929544255360:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 4218us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.325851:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:1.0:1787118907.331897:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.332471:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255616 00000100:00100000:0.0:1787118907.332482:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255616 00000100:00100000:1.0:1787118907.332663:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:1.0:1787118907.332673:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:14451:x1873929544255616:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787118907.332694:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118907.332714:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f99d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdc5 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332801:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332825:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332836:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332901:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332910:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.332917:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.333761:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f99ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.333773:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f99ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.333782:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f99ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118907.333792:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787118907.334445:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334454:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334460:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334467:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.334471:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334478:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334491:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96135456fc00) 00010000:00010000:1.0:1787118907.334494:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.334498:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334515:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f99e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334529:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334534:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334539:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334544:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.334547:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334552:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334560:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96136106bf00) 00010000:00010000:1.0:1787118907.334562:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.334565:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.334569:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.335482:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f99d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdc5 expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.335514:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8c00/0xaa534e3c784f99ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdc5 expref: 9 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.335521:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96136106b000) 00010000:00010000:1.0:1787118907.335524:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.335526:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8c00, rc 0) 00000100:00100000:1.0:1787118907.335691:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14451:x1873929544255616:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 3018us (3801us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787118907.335700:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:3.0:1787118907.346925:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.347583:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255744 00000100:00100000:0.0:1787118907.347598:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255744 00000100:00100000:0.0:1787118907.347672:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:0.0:1787118907.347683:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14451:x1873929544255744:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787118907.347833:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14451:x1873929544255744:12345-192.168.203.10@tcp:59:lhsmtool_posix.0 Request processed in 151us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.347840:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:3.0:1787118907.423801:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.423975:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544255872 00000100:00100000:2.0:1787118907.423990:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544255872 00000100:00100000:1.0:1787118907.424240:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:1.0:1787118907.424254:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14457:x1873929544255872:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118907.424275:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118907.424297:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdcc expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424357:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424371:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424382:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424397:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424421:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424428:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424707:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424715:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.424750:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425242:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.425248:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425256:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425269:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118907.425272:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.425277:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425283:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425298:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425312:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425318:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425322:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.425325:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425331:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425338:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96136106bf00) 00010000:00010000:1.0:1787118907.425341:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.425344:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425349:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425384:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdcc expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425394:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118907.425396:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.425399:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8800/0xaa534e3c784f99fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdcc expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.425419:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8800, rc 0) 00000100:00100000:1.0:1787118907.425494:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14457:x1873929544255872:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1243us (1706us total) trans 0 rc 301/301 00000100:00100000:1.0:1787118907.425501:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:1.0:1787118907.435500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.435650:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256000 00000100:00100000:0.0:1787118907.435661:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256000 00000100:00100000:0.0:1787118907.435712:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:0.0:1787118907.435757:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14457:x1873929544256000:12345-192.168.203.10@tcp:700:lfs.0 00000100:00100000:0.0:1787118907.436121:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14457:x1873929544256000:12345-192.168.203.10@tcp:700:lfs.0 Request processed in 390us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.436130:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118907.451534:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.453242:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256256 00000100:00100000:0.0:1787118907.453258:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256256 00000100:00100000:0.0:1787118907.453336:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:0.0:1787118907.453348:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14457:x1873929544256256:12345-192.168.203.10@tcp:36:lfs.0 00010000:00010000:0.0:1787118907.453402:0:14437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118907.453429:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f993f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bd47 expref: 9 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.453450:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:0.0:1787118907.453454:0:14437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787118907.453945:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.453962:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 5 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.453970:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.456194:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 5 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.456219:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 5 pid: 14437 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118907.456239:0:14437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566269312:192.168.203.10@tcp:104: 00000100:00100000:0.0:1787118907.456357:0:14437:0:(client.c:2702:ptlrpc_set_wait()) set ffff96137f886f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787118907.459220:0:14437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136ebc5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566269312:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118907.459267:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118907.462369:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.462612:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256384 00000100:00100000:0.0:1787118907.462626:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256384 00010000:00010000:0.0:1787118907.462703:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 6 pid: 14437 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118907.462782:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118907.462798:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2369:x1873929544256384:12345-192.168.203.10@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1787118907.462829:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787118907.462830:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118907.462844:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 6 pid: 14437 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.462867:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 6 pid: 14437 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.462897:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9977 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bda9 expref: 6 pid: 14437 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.462918:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:0.0:1787118907.462925:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.462936:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.462946:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.463007:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118907.463089:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544256384:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 295us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.463098:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00010000:00010000:1.0:1787118907.463225:0:14437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.463241:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.463276:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.463289:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.463300:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118907.470360:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787118907.470381:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470393:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470401:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470422:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.470427:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470435:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470453:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118907.470456:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118907.470461:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.470467:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9a11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118907.470490:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008efd581d reply state 0000000040c5ccec transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118907.470499:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118907.470601:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+10:14457:x1873929544256256:12345-192.168.203.10@tcp:36:lfs.0 Request processed in 17252us (19079us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787118907.470611:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00010000:00010000:0.0:1787118907.472576:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472611:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472620:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472627:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118907.472632:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472640:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472659:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96136106bf00) 00010000:00010000:0.0:1787118907.472663:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118907.472668:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.472675:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9a18 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.530097:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118907.583573:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118907.583775:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256512 00000100:00100000:1.0:1787118907.583788:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256512 00000100:00100000:1.0:1787118907.583878:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:1.0:1787118907.583892:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:14465:x1873929544256512:12345-192.168.203.10@tcp:101:lctl.0 00010000:00010000:1.0:1787118907.583924:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118907.583955:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdd3 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.584068:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8e00/0xaa534e3c784f9a26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.584084:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8e00/0xaa534e3c784f9a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.584099:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8e00/0xaa534e3c784f9a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118907.584188:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787118907.584193:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787118907.586009:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8e00/0xaa534e3c784f9a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.586069:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdd3 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.586096:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8e00/0xaa534e3c784f9a26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdd3 expref: 10 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.586107:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118907.586110:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787118907.586124:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8e00, rc 0) 00000100:00100000:1.0:1787118907.589946:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+10:14465:x1873929544256512:12345-192.168.203.10@tcp:101:lctl.0 Request processed in 6039us (6369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118907.589963:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:3.0:1787118907.622312:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.622859:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256640 00000100:00100000:0.0:1787118907.622898:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256640 00000100:00100000:0.0:1787118907.622985:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:0.0:1787118907.622998:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:14466:x1873929544256640:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:0.0:1787118907.623024:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118907.623052:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdda expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623146:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f9a34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623171:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623185:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118907.623262:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787118907.623267:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118907.623302:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f9a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623332:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdda expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623354:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80c00/0xaa534e3c784f9a34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdda expref: 6 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.623363:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:0.0:1787118907.623366:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787118907.623370:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb80c00, rc 0) 00000100:00100000:0.0:1787118907.623526:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:14466:x1873929544256640:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 531us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.623534:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:3.0:1787118907.628467:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.629314:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544256768 00000100:00100000:2.0:1787118907.629334:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544256768 00000100:00100000:2.0:1787118907.629484:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:2.0:1787118907.629498:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:14466:x1873929544256768:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118907.629525:0:16315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118907.629569:0:16315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bde1 expref: -99 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629658:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629675:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629687:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629705:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629713:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.629720:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.639917:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.639940:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.639954:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118907.640025:0:16315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787118907.640029:0:16315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118907.640057:0:16315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640096:0:16315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640103:0:16315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640110:0:16315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640125:0:16315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e986c00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.640130:0:16315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640138:0:16315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640151:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:3.0:1787118907.640154:0:16315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.640158:0:16315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640178:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9a42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640198:0:16315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640205:0:16315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640211:0:16315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640216:0:16315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.640220:0:16315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640226:0:16315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640234:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96134bc94d00) 00010000:00010000:3.0:1787118907.640237:0:16315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.640240:0:16315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640246:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9a49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640285:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bde1 expref: 8 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640309:0:16315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bde1 expref: 7 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.640316:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961351704f00) 00010000:00010000:3.0:1787118907.640318:0:16315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787118907.640321:0:16315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8ce00, rc 0) 00000100:00100000:3.0:1787118907.640396:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6e5e66e-017b-467b-b68a-c042fe6d629f+7:14466:x1873929544256768:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 10901us (11937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118907.640405:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 22 00000100:00100000:0.0:1787118907.648293:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118907.648388:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544257024 00000100:00100000:3.0:1787118907.648400:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544257024 00000100:00100000:3.0:1787118907.648476:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:3.0:1787118907.648488:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+7:14466:x1873929544257024:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118907.648515:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118907.648541:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bde8 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118907.648705:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787118907.648896:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bde8 expref: 9 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.648914:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:3.0:1787118907.648919:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787118907.648925:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bde8 expref: 9 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.648971:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c000, rc 0) 00000100:00100000:3.0:1787118907.649041:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+8:14466:x1873929544257024:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 556us (763us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787118907.649050:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 23 00000100:00100000:3.0:1787118907.652095:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118907.652225:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544257280 00000100:00100000:1.0:1787118907.652236:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544257280 00000100:00100000:1.0:1787118907.652332:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:1.0:1787118907.652344:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+8:14466:x1873929544257280:12345-192.168.203.10@tcp:36:lfs.0 00010000:00010000:1.0:1787118907.652413:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118907.652449:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8ce00/0xaa534e3c784f9a50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bde1 expref: 8 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.652474:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961351704f00) 00010000:00010000:1.0:1787118907.652486:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118907.652517:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.652531:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.652542:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118907.652894:0:14436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc1420d8 reply state 0000000047274eda transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118907.652905:0:14436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787118907.652920:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787118907.653017:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+9:14466:x1873929544257280:12345-192.168.203.10@tcp:36:lfs.0 Request processed in 675us (937us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787118907.653026:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 24 00000100:00100000:0.0:1787118907.663215:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.663861:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544257536 00000100:00100000:2.0:1787118907.663874:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544257536 00000100:00100000:2.0:1787118907.663952:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:2.0:1787118907.663964:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+9:14466:x1873929544257536:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118907.664325:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+10:14466:x1873929544257536:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 361us (1123us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787118907.664334:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:2.0:1787118907.667197:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118907.667293:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544257792 00000100:00100000:3.0:1787118907.667317:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544257792 00000100:00100000:3.0:1787118907.667393:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:3.0:1787118907.667404:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+10:14466:x1873929544257792:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:3.0:1787118907.667435:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118907.667462:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdef expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667559:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667587:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667601:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667621:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667630:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.667662:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118907.667886:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787118907.668009:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668018:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668025:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668032:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8dc00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.668036:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668045:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668059:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:3.0:1787118907.668063:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.668068:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668075:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9a73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668091:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668126:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668133:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668138:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8de00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.668142:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668150:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668159:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961351704d00) 00010000:00010000:3.0:1787118907.668162:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.668165:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668172:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9a7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668173:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668187:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668205:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668211:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118907.668214:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668222:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668227:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdef expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118907.668234:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106bd00) 00010000:00010000:1.0:1787118907.668238:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787118907.668242:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:1.0:1787118907.668242:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668249:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118907.668256:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9a65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668257:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdef expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.668294:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8c000, rc 0) 00000100:00100000:3.0:1787118907.668386:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+10:14466:x1873929544257792:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 983us (1201us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787118907.668395:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 25 00000100:00100000:3.0:1787118907.671402:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118907.671489:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544257920 00000100:00100000:1.0:1787118907.671503:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544257920 00000100:00100000:1.0:1787118907.671581:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:1.0:1787118907.671592:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+10:14466:x1873929544257920:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:1.0:1787118907.671625:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118907.671939:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8400/0xaa534e3c784f9a88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdf6 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672173:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672209:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672223:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118907.672292:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787118907.672415:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118907.672451:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672485:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8400/0xaa534e3c784f9a88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672507:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.672517:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106b600) 00010000:00010000:2.0:1787118907.672520:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787118907.672525:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118907.672673:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+11:14466:x1873929544257920:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 1081us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118907.672683:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 26 00000100:00100000:1.0:1787118907.676849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.676973:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258048 00000100:00100000:2.0:1787118907.676984:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258048 00000100:00100000:2.0:1787118907.677057:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:2.0:1787118907.677069:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+11:14466:x1873929544258048:12345-192.168.203.10@tcp:37:lfs.0 00000100:00100000:2.0:1787118907.682014:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+11:14466:x1873929544258048:12345-192.168.203.10@tcp:37:lfs.0 Request processed in 4932us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118907.682043:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:3.0:1787118907.686291:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.686505:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258304 00000100:00100000:0.0:1787118907.686517:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258304 00000100:00100000:0.0:1787118907.686596:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:0.0:1787118907.686608:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+11:14466:x1873929544258304:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118907.686972:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6e5e66e-017b-467b-b68a-c042fe6d629f+12:14466:x1873929544258304:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 364us (693us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787118907.686981:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:1.0:1787118907.737615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118907.737823:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258432 00000100:00100000:3.0:1787118907.737836:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258432 00000100:00100000:3.0:1787118907.737913:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:3.0:1787118907.737924:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+10:14472:x1873929544258432:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:3.0:1787118907.737951:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118907.737977:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2bdfd expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738059:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738076:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738089:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738106:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738125:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738153:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738305:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9aab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738314:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738321:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787118907.738358:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787118907.738362:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787118907.738412:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738426:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738432:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738439:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738446:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.738450:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738459:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738482:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:3.0:1787118907.738485:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.738491:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738497:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c000/0xaa534e3c784f9a9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738515:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738521:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738527:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738533:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8de00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118907.738536:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738542:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738550:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961351704d00) 00010000:00010000:3.0:1787118907.738552:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787118907.738555:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738561:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9aa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.738987:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdfd expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.739004:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8dc00/0xaa534e3c784f9aab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdfd expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.739013:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106b600) 00010000:00010000:3.0:1787118907.739015:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787118907.739018:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8dc00, rc 0) 00000100:00100000:2.0:1787118907.739319:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+11:14472:x1873929544258432:12345-192.168.203.10@tcp:101:bash.0 Request processed in 1394us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118907.739331:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 27 00000100:00100000:1.0:1787118907.756889:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118907.757128:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258688 00000100:00100000:3.0:1787118907.757141:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258688 00000100:00100000:3.0:1787118907.757222:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:3.0:1787118907.757234:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+11:14472:x1873929544258688:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:3.0:1787118907.757262:0:16315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118907.757290:0:16315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9ab2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be04 expref: -99 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.757458:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.757476:0:16315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.757484:0:16315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.757526:0:16315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.757548:0:16315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 11 pid: 14436 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118907.757565:0:16315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137a767b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16315:1873929566269440:192.168.203.10@tcp:104: 00000100:00100000:3.0:1787118907.757713:0:16315:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d88cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787118907.759868:0:16315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137a767b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16315:1873929566269440:192.168.203.10@tcp:104: 00010000:00010000:0.0:1787118907.759907:0:16315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118907.761414:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.761520:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258816 00000100:00100000:2.0:1787118907.761531:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258816 00010000:00010000:2.0:1787118907.761590:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 12 pid: 14436 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118907.761640:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:2.0:1787118907.761651:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+12:2368:x1873929544258816:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118907.761671:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118907.761679:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 12 pid: 14436 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761693:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 12 pid: 14436 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761767:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9a8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2bdf6 expref: 12 pid: 14436 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761791:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106b600) 00010000:00010000:2.0:1787118907.761797:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761809:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761839:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.761878:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118907.761941:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+11:2368:x1873929544258816:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 291us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118907.761950:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00010000:00010000:3.0:1787118907.762464:0:16315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118907.762475:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.762989:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.763007:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.763017:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765627:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765652:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765664:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118907.765677:0:16315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787118907.765715:0:16315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765748:0:16315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765776:0:16315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765782:0:16315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118907.765786:0:16315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765795:0:16315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765809:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106b600) 00010000:00010000:2.0:1787118907.765812:0:16315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118907.765817:0:16315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765823:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8d400/0xaa534e3c784f9ab9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787118907.765841:0:16315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fca70280 reply state 000000000cd3a4c1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118907.765850:0:16315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787118907.765895:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8c600/0xaa534e3c784f9ab2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 14 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765913:0:16315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 13 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.765920:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118907.765928:0:16315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787118907.765931:0:16315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987000, rc 0) 00000100:00100000:2.0:1787118907.766036:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:14472:x1873929544258688:12345-192.168.203.10@tcp:101:bash.0 Request processed in 8803us (9161us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787118907.766046:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 28 00010000:00010000:0.0:1787118907.772316:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772334:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772341:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772347:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:0.0:1787118907.772352:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772376:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772403:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961351704d00) 00010000:00010000:0.0:1787118907.772406:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787118907.772409:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.772422:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987400/0xaa534e3c784f9ac0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118907.778638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.778766:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544258944 00000100:00100000:0.0:1787118907.778777:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544258944 00000100:00100000:0.0:1787118907.778841:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:0.0:1787118907.778852:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14472:x1873929544258944:12345-192.168.203.10@tcp:101:bash.0 00010000:00010000:0.0:1787118907.778876:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118907.778908:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9ad5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be0b expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.778977:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.778990:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.779000:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787118907.779038:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787118907.779055:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787118907.779079:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.779090:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.779124:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb80600/0xaa534e3c784f9ad5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.779142:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118907.779150:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:0.0:1787118907.779153:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787118907.779156:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81200, rc 0) 00000100:00100000:0.0:1787118907.779216:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:14472:x1873929544258944:12345-192.168.203.10@tcp:101:bash.0 Request processed in 367us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118907.779223:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:1.0:1787118907.784238:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.784320:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544259200 00000100:00100000:0.0:1787118907.784329:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544259200 00000100:00100000:0.0:1787118907.784396:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:0.0:1787118907.784406:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:14472:x1873929544259200:12345-192.168.203.10@tcp:35:bash.0 00000100:00100000:0.0:1787118907.784802:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14472:x1873929544259200:12345-192.168.203.10@tcp:35:bash.0 Request processed in 397us (573us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787118907.787664:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000040:00080000:3.0:1787118907.851229:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787118907.891692:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.891859:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544259456 00000100:00100000:2.0:1787118907.891869:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544259456 00000100:00100000:2.0:1787118907.891926:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:2.0:1787118907.891936:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14482:x1873929544259456:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118907.891958:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118907.891984:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be12 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118907.892096:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787118907.892219:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9ae3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be12 expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.892234:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96136106b500) 00010000:00010000:2.0:1787118907.892237:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118907.892243:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be12 expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.892259:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118907.892322:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14482:x1873929544259456:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 388us (650us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787118907.892331:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 30 00000100:00100000:1.0:1787118907.900013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118907.900174:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544259712 00000100:00100000:0.0:1787118907.900184:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544259712 00000100:00100000:0.0:1787118907.900245:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:0.0:1787118907.900270:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14482:x1873929544259712:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:0.0:1787118907.900826:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14482:x1873929544259712:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 556us (820us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787118907.900834:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:1.0:1787118907.986945:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118907.987093:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544259968 00000100:00100000:2.0:1787118907.987124:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544259968 00000100:00100000:2.0:1787118907.987179:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:2.0:1787118907.987189:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14485:x1873929544259968:12345-192.168.203.10@tcp:101:lfs.0 00010000:00010000:2.0:1787118907.987211:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118907.987228:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9af1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be19 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.987323:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9af8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.987335:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.987348:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118907.987358:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787118907.987473:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9af1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be19 expref: 20 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.987493:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9af8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be19 expref: 19 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118907.987501:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118907.987504:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118907.987507:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986c00, rc 0) 00000100:00100000:2.0:1787118907.987563:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14485:x1873929544259968:12345-192.168.203.10@tcp:101:lfs.0 Request processed in 376us (629us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787118907.987569:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 31 00000100:00100000:3.0:1787118908.009206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118908.009252:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.009347:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544260224 00000100:00100000:2.0:1787118908.009356:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544260224 00000100:00100000:2.0:1787118908.009412:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:2.0:1787118908.009423:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14485:x1873929544260224:12345-192.168.203.10@tcp:54:lfs.0 00010000:00010000:2.0:1787118908.009485:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009501:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009512:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009537:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009544:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009551:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009557:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987e00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.009561:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009568:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009579:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.009582:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787118908.009611:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.009617:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.009701:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14485:x1873929544260224:12345-192.168.203.10@tcp:54:lfs.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.009710:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 32 00000100:00100000:1.0:1787118908.010471:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544260096 00000100:00100000:1.0:1787118908.010477:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544260096 00000100:00100000:1.0:1787118908.010520:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:1.0:1787118908.010527:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:2371:x1873929544260096:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118908.010538:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118908.010555:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986c00/0xaa534e3c784f9af8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be19 expref: 19 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.010569:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:1.0:1787118908.010573:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118908.010609:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:2371:x1873929544260096:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 83us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118908.010616:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118908.028853:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.029009:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544260480 00000100:00100000:2.0:1787118908.029018:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544260480 00000100:00100000:2.0:1787118908.029075:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:2.0:1787118908.029085:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:14485:x1873929544260480:12345-192.168.203.10@tcp:35:lfs.0 00000100:00100000:2.0:1787118908.029319:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14485:x1873929544260480:12345-192.168.203.10@tcp:35:lfs.0 Request processed in 235us (476us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787118908.029327:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000001:00080000:0.0:1787118908.291136:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:0.0:1787118908.291154:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787118908.291166:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000100:00100000:0.0:1787118908.448373:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.448487:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544260736 00000100:00100000:2.0:1787118908.448507:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544260736 00000100:00100000:2.0:1787118908.448565:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:2.0:1787118908.448576:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+11:14516:x1873929544260736:12345-192.168.203.10@tcp:101:cat.0 00010000:00010000:2.0:1787118908.448610:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118908.448631:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b0d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be20 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.448763:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9b14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.448784:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9b14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.448811:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9b14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118908.449085:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787118908.449295:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b0d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be20 expref: 14 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.449316:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9b14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be20 expref: 13 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.449324:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.449327:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787118908.449330:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987c00, rc 0) 00000100:00100000:2.0:1787118908.449770:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14516:x1873929544260736:12345-192.168.203.10@tcp:101:cat.0 Request processed in 1194us (1404us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787118908.449779:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 33 00000100:00100000:3.0:1787118908.455956:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118908.456022:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118908.456082:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544260864 00000100:00100000:0.0:1787118908.456090:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544260864 00000100:00100000:0.0:1787118908.456158:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:0.0:1787118908.456168:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:2369:x1873929544260864:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118908.456182:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118908.456206:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987c00/0xaa534e3c784f9b14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be20 expref: 13 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118908.456225:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:0.0:1787118908.456229:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118908.456259:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544261120 00000100:00100000:2.0:1787118908.456263:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544261120 00000100:00100000:2.0:1787118908.456293:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:2.0:1787118908.456300:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14516:x1873929544261120:12345-192.168.203.10@tcp:35:cat.0 00000100:00100000:0.0:1787118908.460574:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:2369:x1873929544260864:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 3505us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118908.460590:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:2.0:1787118908.461697:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14516:x1873929544261120:12345-192.168.203.10@tcp:35:cat.0 Request processed in 5391us (5668us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787118908.461709:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 8 00000100:00100000:0.0:1787118908.535613:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.536322:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544261376 00000100:00100000:2.0:1787118908.536333:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544261376 00000100:00100000:2.0:1787118908.536395:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:2.0:1787118908.536405:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14522:x1873929544261376:12345-192.168.203.10@tcp:101:dd.0 00010000:00010000:2.0:1787118908.536448:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118908.536469:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be27 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536576:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536591:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 14 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536600:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536608:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536641:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.536655:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.536669:0:14436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14436:1873929566269568:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118908.537037:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 14 pid: 16315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.537048:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 14 pid: 16315 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.537071:0:14436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14436:1873929566269696:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118908.537098:0:14436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613452b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787118908.539793:0:14436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14436:1873929566269568:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118908.542251:0:14436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14436:1873929566269696:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118908.542279:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118908.543524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.543579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.543948:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544261632 00000100:00100000:2.0:1787118908.543957:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544261632 00010000:00010000:2.0:1787118908.543993:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 15 pid: 16315 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.544032:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544261504 00000100:00100000:2.0:1787118908.544035:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544261504 00010000:00010000:2.0:1787118908.544048:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 16 pid: 14437 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.544063:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118908.544071:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:2369:x1873929544261632:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118908.544085:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118908.544091:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 16 pid: 16315 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544102:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 16 pid: 16315 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544153:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ac7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be04 expref: 16 pid: 16315 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544181:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.544186:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544194:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544200:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118908.544252:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:2369:x1873929544261632:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 181us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.544259:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:2.0:1787118908.544519:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:2.0:1787118908.544527:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:2369:x1873929544261504:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787118908.544536:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118908.544541:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544551:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544565:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81200/0xaa534e3c784f9adc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be0b expref: 14 pid: 14437 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544596:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.544600:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544608:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544615:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544641:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118908.544664:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:2369:x1873929544261504:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 138us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.544671:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00010000:00010000:2.0:1787118908.544692:0:14436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544700:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118908.544716:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787118908.544917:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be27 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544933:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986a00/0xaa534e3c784f9b29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be27 expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.544939:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.544948:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787118908.544951:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986a00, rc 0) 00000100:00100000:2.0:1787118908.544977:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14522:x1873929544261376:12345-192.168.203.10@tcp:101:dd.0 Request processed in 8575us (9374us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787118908.544984:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 34 00000100:00100000:0.0:1787118908.548295:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.548638:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544261888 00000100:00100000:2.0:1787118908.548647:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544261888 00000100:00100000:2.0:1787118908.548701:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 35 00000100:00100000:2.0:1787118908.548711:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:14522:x1873929544261888:12345-192.168.203.10@tcp:36:dd.0 00010000:00010000:2.0:1787118908.550035:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.550054:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.550066:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118908.550126:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787118908.550172:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f68489e reply state 000000008d5b8751 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.550180:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118908.550558:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14522:x1873929544261888:12345-192.168.203.10@tcp:36:dd.0 Request processed in 1843us (2268us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787118908.550565:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 35 00000020:00080000:2.0:1787118908.550696:0:14437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787118908.554471:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787118908.563791:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118908.563828:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262016 00000100:00100000:3.0:1787118908.563837:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262016 00000100:00100000:3.0:1787118908.563889:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 36 00000100:00100000:3.0:1787118908.563899:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14522:x1873929544262016:12345-192.168.203.10@tcp:101:dd.0 00010000:00010000:3.0:1787118908.563920:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787118908.563939:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9b3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be2e expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.564008:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9b3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be2e expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.564021:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9b3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be2e expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.564038:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:3.0:1787118908.564041:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787118908.564044:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961350e8de00, rc 0) 00000100:00100000:3.0:1787118908.564093:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14522:x1873929544262016:12345-192.168.203.10@tcp:101:dd.0 Request processed in 195us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118908.564099:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 36 00010000:00010000:1.0:1787118908.564392:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564401:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564406:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564422:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118908.564427:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564434:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564445:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:1.0:1787118908.564447:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118908.564451:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.564456:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9b37 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118908.578481:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.578586:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262272 00000100:00100000:2.0:1787118908.578596:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262272 00000100:00100000:2.0:1787118908.578666:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:2.0:1787118908.578691:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14522:x1873929544262272:12345-192.168.203.10@tcp:103:dd.0 00010000:00010000:2.0:1787118908.578707:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118908.578779:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961350e8de00/0xaa534e3c784f9b3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be2e expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.578808:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.578819:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787118908.578914:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14522:x1873929544262272:12345-192.168.203.10@tcp:103:dd.0 Request processed in 225us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.578922:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:3.0:1787118908.582334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118908.583665:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262400 00000100:00100000:0.0:1787118908.583676:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262400 00000100:00100000:0.0:1787118908.583776:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:0.0:1787118908.583787:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14522:x1873929544262400:12345-192.168.203.10@tcp:58:dd.0 00010000:00010000:0.0:1787118908.583889:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118908.583907:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118908.583917:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787118908.584620:0:14435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787118908.584795:0:14435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787118908.584866:0:14435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787118908.584964:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14522:x1873929544262400:12345-192.168.203.10@tcp:58:dd.0 Request processed in 1176us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118908.584973:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 37 00000100:00100000:3.0:1787118908.587768:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.587861:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262528 00000100:00100000:2.0:1787118908.587870:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262528 00000100:00100000:2.0:1787118908.587927:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:2.0:1787118908.587936:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14522:x1873929544262528:12345-192.168.203.10@tcp:101:dd.0 00010000:00010000:2.0:1787118908.587954:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118908.587972:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be35 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588020:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588030:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588046:0:14436:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588057:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588081:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.588084:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118908.588088:0:14436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.588095:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987e00, rc 0) 00000100:00100000:2.0:1787118908.588153:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14522:x1873929544262528:12345-192.168.203.10@tcp:101:dd.0 Request processed in 218us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.588168:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 38 00000100:00100000:2.0:1787118908.746263:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566269952:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.746341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118908.746396:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566270464:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.746422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118908.746445:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787118908.746451:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.746480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118908.746519:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566269952 00000100:00100000:2.0:1787118908.746526:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566269952 00000100:00100000:2.0:1787118908.746586:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270080 00000100:00100000:2.0:1787118908.746589:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270080 00000100:00100000:2.0:1787118908.746609:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118908.746617:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566269952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.746679:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566269952:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.746687:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787118908.746747:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787118908.746756:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566270080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.746789:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873929566270080:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.746795:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787118908.747006:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787118908.747012:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787118908.747049:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.747060:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1873929566269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787118908.747200:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566270208:0@lo:400:kworker.0 00000100:00100000:3.0:1787118908.747232:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118908.747262:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787118908.747269:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566269824:0@lo:400:kworker.0 00000100:00100000:3.0:1787118908.747294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118908.747316:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566270336:0@lo:400:kworker.0 00000100:00100000:3.0:1787118908.747338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118908.747458:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270464 00000100:00100000:2.0:1787118908.747463:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270464 00000100:00100000:2.0:1787118908.747501:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270208 00000100:00100000:2.0:1787118908.747504:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270208 00000100:00100000:2.0:1787118908.747515:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270336 00000100:00100000:2.0:1787118908.747517:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270336 00000100:00100000:2.0:1787118908.747532:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787118908.747538:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566270464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.747777:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873929566270464:12345-0@lo:400:kworker.0 Request processed in 104us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.747784:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787118908.747801:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787118908.747807:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566270208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118908.747968:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787118908.748000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787118908.748049:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118908.748057:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566270336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787118908.748092:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873929566270336:12345-0@lo:400:kworker.0 Request processed in 37us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118908.748115:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787118908.748154:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1873929566270464:0@lo:400:kworker.0 00000100:00100000:0.0:1787118908.748262:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566269824 00000100:00100000:0.0:1787118908.748266:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566269824 00000100:00100000:0.0:1787118908.748297:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787118908.748304:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3298:x1873929566269824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787118908.748338:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a15e2bd8-d402-42e4-a923-f01b19147eee+19:3298:x1873929566269824:12345-0@lo:400:kworker.0 Request processed in 35us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118908.748345:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787118908.748754:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1873929566270208:12345-0@lo:400:kworker.0 Request processed in 945us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.748762:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787118908.748973:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270592 00000100:00100000:3.0:1787118908.748978:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270592 00000100:00100000:3.0:1787118908.749011:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787118908.749019:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566270592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787118908.749055:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118908.749113:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873929566270592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118908.749120:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787118908.749138:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787118908.749958:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a15e2bd8-d402-42e4-a923-f01b19147eee:3298:1873929566269824:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.749998:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1873929566270336:0@lo:400:kworker.0 00000100:00100000:2.0:1787118908.750008:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1873929566270208:0@lo:400:kworker.0 00000100:00100000:3.0:1787118908.750061:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1873929566270592:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787118908.873939:0:14466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787118908.873950:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118908.873985:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787118908.873993:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787118908.874132:0:14466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96124139bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14466:1873929566270720:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787118908.874299:0:14466:0:(client.c:2702:ptlrpc_set_wait()) set ffff961342d88840 going to sleep for 11 seconds 00000100:00100000:2.0:1787118908.881700:0:14466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96124139bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14466:1873929566270720:192.168.203.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787118908.884081:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.884209:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262656 00000100:00100000:1.0:1787118908.884217:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262656 00000100:00100000:1.0:1787118908.884277:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:1.0:1787118908.884300:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262656:12345-192.168.203.10@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787118908.884383:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262656:12345-192.168.203.10@tcp:900:lhsmtool_posix.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118908.884390:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118908.889073:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.889186:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262784 00000100:00100000:1.0:1787118908.889195:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262784 00000100:00100000:1.0:1787118908.889261:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:1.0:1787118908.889275:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262784:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787118908.889307:0:14437:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787118908.889457:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262784:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 187us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118908.889465:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 39 00000100:00100000:3.0:1787118908.895637:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.895790:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544262912 00000100:00100000:2.0:1787118908.895800:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544262912 00000100:00100000:2.0:1787118908.895865:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:2.0:1787118908.895876:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96124139bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262912:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787118908.895946:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.895962:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.895977:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896042:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896050:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896057:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896077:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896085:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896114:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118908.896155:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787118908.896159:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118908.896187:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896198:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896204:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896211:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896216:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.896220:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896235:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896246:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96136106b000) 00010000:00010000:2.0:1787118908.896249:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118908.896253:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896259:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9b53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896284:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896290:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896296:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896302:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.896305:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896311:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896318:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96134bc94800) 00010000:00010000:2.0:1787118908.896321:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118908.896324:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896330:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896343:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896348:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896353:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896364:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.896367:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896373:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896382:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118908.896384:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118908.896387:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.896392:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.896460:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96124139bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544262912:12345-192.168.203.10@tcp:34:lhsmtool_posix.0 Request processed in 586us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.896468:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 40 00000100:00100000:0.0:1787118908.906118:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.906207:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544263168 00000100:00100000:1.0:1787118908.906217:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544263168 00000100:00100000:1.0:1787118908.906283:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:1.0:1787118908.906293:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:14523:x1873929544263168:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787118908.906312:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118908.906332:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9b68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be3c expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906425:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906439:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906450:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787118908.906475:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787118908.906570:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906577:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906584:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906590:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9400 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118908.906594:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906601:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906627:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:1.0:1787118908.906630:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787118908.906635:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906640:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906687:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9b68 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be3c expref: 18 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906696:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96136106b000) 00010000:00010000:1.0:1787118908.906699:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787118908.906709:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9b68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be3c expref: 18 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.906719:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c8600, rc 0) 00000100:00100000:1.0:1787118908.906821:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14523:x1873929544263168:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 529us (725us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787118908.906829:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 41 00000100:00100000:3.0:1787118908.917974:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.918159:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544263296 00000100:00100000:2.0:1787118908.918170:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544263296 00000100:00100000:2.0:1787118908.918240:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:2.0:1787118908.918249:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14523:x1873929544263296:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787118908.918282:0:14435:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787118908.918394:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14523:x1873929544263296:12345-192.168.203.10@tcp:53:lhsmtool_posix.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.918403:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 42 00000100:00100000:3.0:1787118908.930822:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.930903:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544263552 00000100:00100000:1.0:1787118908.930912:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544263552 00000100:00100000:1.0:1787118908.930973:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:1.0:1787118908.930983:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:14523:x1873929544263552:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787118908.931004:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787118908.931025:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9b7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be43 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787118908.932569:0:14437:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787118908.932577:0:14437:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787118908.932617:0:14437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787118908.933041:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.933057:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.933069:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.933138:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9b7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be43 expref: 20 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.933168:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be43 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118908.933176:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96136106bd00) 00010000:00010000:1.0:1787118908.933179:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787118908.933183:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96137f6c9400, rc 0) 00000100:00100000:1.0:1787118908.937469:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14523:x1873929544263552:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 6476us (7229us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787118908.937481:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 43 00000100:00100000:0.0:1787118908.945340:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.945442:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544263808 00000100:00100000:2.0:1787118908.945452:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544263808 00000100:00100000:2.0:1787118908.945522:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:2.0:1787118908.945532:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14523:x1873929544263808:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787118908.945598:0:14435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787118908.945624:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9400/0xaa534e3c784f9b84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be43 expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945644:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96136106bd00) 00010000:00010000:2.0:1787118908.945654:0:14435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787118908.945684:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945697:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945707:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945823:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945831:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.945837:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946088:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946096:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946122:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946129:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987800 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.946133:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946140:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946149:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96136106b600) 00010000:00010000:2.0:1787118908.946153:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118908.946157:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946163:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9b92 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946173:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946180:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946186:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946191:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118908.946194:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946210:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946219:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd1028b89 (ffff96134bc94800) 00010000:00010000:2.0:1787118908.946221:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118908.946224:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.946229:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9b99 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd1028b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.946359:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:14523:x1873929544263808:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 828us (1028us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787118908.946368:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 44 00000100:00100000:3.0:1787118908.953496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.953574:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544263936 00000100:00100000:2.0:1787118908.953582:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544263936 00000100:00100000:2.0:1787118908.953634:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:2.0:1787118908.953643:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:14523:x1873929544263936:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118908.953662:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118908.953689:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ba0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be4a expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953769:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f9ba7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953782:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953793:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953898:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9ba0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be4a expref: 20 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953917:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e986400/0xaa534e3c784f9ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be4a expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.953925:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118908.953928:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787118908.953931:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e986400, rc 0) 00000100:00100000:2.0:1787118908.953981:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14523:x1873929544263936:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 338us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.953988:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 45 00000100:00100000:3.0:1787118908.959253:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.959385:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544264192 00000100:00100000:2.0:1787118908.959394:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544264192 00000100:00100000:2.0:1787118908.959446:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 46 00000100:00100000:2.0:1787118908.959455:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:14523:x1873929544264192:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787118908.959534:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.959549:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.959560:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787118908.959925:0:14435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787118908.959935:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 488117212044ns, next at 489117209914ns, rc = 0 00000004:00010000:2.0:1787118908.960024:0:14435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000053d49eb reply state 00000000b2792b08 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118908.960033:0:14435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787118908.960369:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+21:14523:x1873929544264192:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 913us (1122us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787118908.960377:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 46 00010000:00010000:3.0:1787118908.966993:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967010:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967018:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967025:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987200 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:3.0:1787118908.967045:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967061:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967078:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:3.0:1787118908.967081:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787118908.967084:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118908.967091:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118908.985440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.985540:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544264320 00000100:00100000:2.0:1787118908.985549:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544264320 00000100:00100000:2.0:1787118908.985612:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:2.0:1787118908.985622:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:14523:x1873929544264320:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118908.985644:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118908.985664:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be51 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.985771:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 21 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.985787:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 21 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118908.985806:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118908.985809:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118908.985823:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987000, rc 0) 00000100:00100000:2.0:1787118908.985879:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+21:14523:x1873929544264320:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 258us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118908.985887:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 47 00000100:00100000:0.0:1787118908.989675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118908.989989:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544264448 00000100:00100000:2.0:1787118908.990012:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544264448 00000100:00100000:2.0:1787118908.990098:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00100000:2.0:1787118908.990118:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544264448:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787118908.990474:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2369:x1873929544264448:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 357us (808us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787118908.990482:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 12 00000100:00080000:3.0:1787118908.991075:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787118908.993969:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.994101:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544264704 00000100:00100000:1.0:1787118908.994119:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544264704 00000100:00100000:1.0:1787118908.994187:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:1.0:1787118908.994198:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+21:14523:x1873929544264704:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787118908.994435:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+22:14523:x1873929544264704:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 239us (475us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787118908.994444:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 9 00000100:00100000:0.0:1787118908.997645:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118908.997770:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544264960 00000100:00100000:1.0:1787118908.997779:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544264960 00000100:00100000:1.0:1787118908.997843:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:1.0:1787118908.997853:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+22:14523:x1873929544264960:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787118908.997959:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+22:14523:x1873929544264960:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118908.997966:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 48 00000100:00100000:0.0:1787118909.000948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.001319:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265088 00000100:00100000:2.0:1787118909.001328:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265088 00000100:00100000:2.0:1787118909.001436:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00100000:2.0:1787118909.001447:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+22:14523:x1873929544265088:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118909.001467:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118909.001486:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9bbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be58 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001552:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001575:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001586:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787118909.001623:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787118909.001641:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001666:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987800/0xaa534e3c784f9bbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be58 expref: 24 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001704:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be58 expref: 23 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.001712:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118909.001715:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787118909.001718:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987200, rc 0) 00000100:00100000:2.0:1787118909.001821:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+23:14523:x1873929544265088:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 376us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118909.001829:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 49 00000100:00080000:3.0:1787118909.002626:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787118909.005371:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.005491:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265216 00000100:00100000:0.0:1787118909.005515:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265216 00000100:00100000:0.0:1787118909.005608:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118909.005618:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+6:2371:x1873929544265216:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787118909.005635:0:15121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787118909.005657:0:15121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be5f expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118909.005681:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85453c, blocks: 0x1 00010000:00010000:0.0:1787118909.005700:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1787118909.005704:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.005713:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 7 pid: 15121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.005776:0:15121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 7 pid: 15121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.005790:0:15121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136eb81200, rc 0) 00000100:00100000:0.0:1787118909.005847:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2371:x1873929544265216:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 231us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118909.005855:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118909.011419:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.011500:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265472 00000100:00100000:1.0:1787118909.011522:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265472 00000100:00100000:1.0:1787118909.011589:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:1.0:1787118909.011599:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+23:14523:x1873929544265472:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787118909.011817:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+23:14523:x1873929544265472:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 219us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118909.011825:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 50 00000100:00100000:3.0:1787118909.014412:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.015010:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265600 00000100:00100000:2.0:1787118909.015018:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265600 00000100:00100000:2.0:1787118909.015094:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 51 00000100:00100000:2.0:1787118909.015112:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961375beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+23:14523:x1873929544265600:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787118909.051047:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961375beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+23:14523:x1873929544265600:12345-192.168.203.10@tcp:44:lhsmtool_posix.0 Request processed in 35935us (36882us total) trans 0 rc 0/0 00000001:00080000:0.0:1787118909.051540:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787118909.051555:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787118909.052751:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787118909.052770:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566270848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787118909.052825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118909.052891:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566270848 00000100:00100000:2.0:1787118909.052897:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566270848 00000100:00100000:2.0:1787118909.052940:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787118909.052949:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1873929566270848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787118909.053258:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 51 00002000:00010000:2.0:1787118909.053409:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787118909.053413:0:15119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787118909.053415:0:15119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787118909.053417:0:15119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787118908 -> 1787118908 00002000:00010000:2.0:1787118909.053420:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1787118909.054188:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96137f73ca80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787118909.054197:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1873929566270848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787118909.054288:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1873929566270848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1338us (1460us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787118909.054297:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787118909.054677:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118909.054829:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265728 00000100:00100000:3.0:1787118909.054837:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265728 00000100:00100000:3.0:1787118909.054915:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:3.0:1787118909.054924:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2369:x1873929544265728:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787118909.055015:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2369:x1873929544265728:12345-192.168.203.10@tcp:16:lhsmtool_posix.0 Request processed in 91us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118909.055021:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:0.0:1787118909.058821:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.058902:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544265984 00000100:00100000:1.0:1787118909.058911:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544265984 00000100:00100000:1.0:1787118909.058963:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:1.0:1787118909.058973:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:14523:x1873929544265984:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787118909.059020:0:16315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118909.059045:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987200/0xaa534e3c784f9bc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be58 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.059075:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:1.0:1787118909.059080:0:16315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787118909.059116:0:16315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.059129:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.059155:0:16315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787118909.059342:0:16315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7603a4d reply state 00000000414e59d7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118909.059351:0:16315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787118909.059541:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:14523:x1873929544265984:12345-192.168.203.10@tcp:36:lhsmtool_posix.0 Request processed in 568us (728us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787118909.059548:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 52 00000100:00100000:0.0:1787118909.064073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00010000:00010000:1.0:1787118909.064835:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.064849:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.064857:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.065043:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:1.0:1787118909.065049:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.065128:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.065144:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:1.0:1787118909.065147:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787118909.065151:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.065236:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9bd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.065310:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266112 00000100:00100000:2.0:1787118909.065320:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266112 00000100:00100000:2.0:1787118909.065403:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:2.0:1787118909.065413:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:14523:x1873929544266112:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787118909.065431:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787118909.065447:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x13724b042ec2be66 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.065475:0:15118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 8 pid: 15121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.065485:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.065489:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.065494:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 8 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.065526:0:15118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 8 pid: 15121 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.065540:0:15118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 8 pid: 15121 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.065554:0:15118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15118:1873929566270976:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118909.065658:0:15118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613452b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118909.069429:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.069811:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266240 00000100:00100000:0.0:1787118909.069835:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266240 00010000:00010000:0.0:1787118909.069873:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 9 pid: 15121 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.069914:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118909.069924:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:2368:x1873929544266240:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118909.069939:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118909.069962:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 9 pid: 15121 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.069976:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 9 pid: 15121 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.069999:0:14422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.070004:0:14422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.070011:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.070021:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.070068:0:14422:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.070082:0:14422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f724e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14422:1873929566271104:192.168.203.10@tcp:105: 00000100:00100000:0.0:1787118909.070176:0:14422:0:(client.c:2702:ptlrpc_set_wait()) set ffff96136e992b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787118909.070344:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9bca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be5f expref: 9 pid: 15121 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.070359:0:15118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15118:1873929566270976:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118909.070381:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 8 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.070392:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96136e987800, rc 0) 00000100:00100000:2.0:1787118909.070421:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+8:14523:x1873929544266112:12345-192.168.203.10@tcp:101:lhsmtool_posix.0 Request processed in 5009us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118909.070428:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 16 00000100:00100000:2.0:1787118909.075071:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118909.075139:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266368 00000100:00100000:3.0:1787118909.075147:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266368 00000100:00100000:3.0:1787118909.075204:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:3.0:1787118909.075227:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+8:2368:x1873929544266368:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787118909.075425:0:15121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787118909.075429:0:15121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787118907 00002000:00010000:3.0:1787118909.075431:0:15121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787118906 00002000:00010000:3.0:1787118909.075433:0:15121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787118908 -> 1787118907 00002000:00010000:3.0:1787118909.075435:0:15121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787118909.075529:0:14422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f724e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14422:1873929566271104:192.168.203.10@tcp:105: 00010000:00010000:1.0:1787118909.075550:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787118909.076688:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:2368:x1873929544266368:12345-192.168.203.10@tcp:2:lhsmtool_posix.0 Request processed in 1457us (1629us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787118909.076700:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 17 00000100:00100000:1.0:1787118909.076850:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+8:2368:x1873929544266240:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 6926us (7430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118909.076859:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 13 00000100:00100000:0.0:1787118909.083799:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.083950:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266496 00000100:00100000:2.0:1787118909.083959:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266496 00000100:00100000:2.0:1787118909.084013:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118909.084023:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+8:2369:x1873929544266496:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787118909.084076:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.084098:0:15118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 8 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.084115:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.084120:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787118909.084135:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.084317:0:15118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 8 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.084332:0:15118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 8 pid: 15118 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.084347:0:15118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15118:1873929566271232:192.168.203.10@tcp:104: 00000100:00100000:2.0:1787118909.084416:0:15118:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613452b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787118909.087672:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.087826:0:15118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15118:1873929566271232:192.168.203.10@tcp:104: 00010000:00010000:2.0:1787118909.087851:0:15118:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.087923:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266624 00000100:00100000:0.0:1787118909.087929:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266624 00010000:00010000:0.0:1787118909.087964:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.087999:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 14 00000100:00100000:0.0:1787118909.088008:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:2368:x1873929544266624:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787118909.088022:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787118909.088042:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.088066:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.088088:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d8a0d14/0xaa534e3c784f9bd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be66 expref: 9 pid: 15118 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.088113:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118909.088117:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787118909.088122:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.088132:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.088160:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787118909.088281:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+8:2368:x1873929544266624:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 273us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118909.088290:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 14 00010000:00010000:2.0:1787118909.088412:0:15118:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088422:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088445:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088454:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088476:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088483:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118909.088487:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088496:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088510:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.088517:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9bdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.088563:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2369:x1873929544266496:12345-192.168.203.10@tcp:1:lhsmtool_posix.0 Request processed in 4542us (4773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118909.088584:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:0.0:1787118909.092551:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.092972:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544266880 00000100:00100000:1.0:1787118909.092981:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544266880 00000100:00100000:1.0:1787118909.093034:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 53 00000100:00100000:1.0:1787118909.093056:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:14523:x1873929544266880:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787118909.093141:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093170:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093180:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093428:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093438:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 15 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093457:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093488:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 15 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.093500:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 15 pid: 14436 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118909.093513:0:14437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96136e2c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566271360:192.168.203.10@tcp:104: 00000100:00100000:1.0:1787118909.093987:0:14437:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134642c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787118909.097685:0:14437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96136e2c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566271360:192.168.203.10@tcp:104: 00010000:00010000:1.0:1787118909.097713:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.099466:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.099680:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267008 00000100:00100000:1.0:1787118909.099689:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267008 00010000:00010000:1.0:1787118909.099753:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 16 pid: 14436 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787118909.099782:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 15 00000100:00100000:1.0:1787118909.099792:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:2368:x1873929544267008:12345-192.168.203.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787118909.099805:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787118909.099811:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 16 pid: 14436 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099841:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 16 pid: 14436 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099862:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987000/0xaa534e3c784f9bb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be51 expref: 16 pid: 14436 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099878:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:1.0:1787118909.099884:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099893:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099900:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.099934:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787118909.099980:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:2368:x1873929544267008:12345-192.168.203.10@tcp:103:ldlm_bl.0 Request processed in 188us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787118909.099988:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 15 00010000:00010000:2.0:1787118909.100089:0:14437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.100098:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118909.100279:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787118909.100420:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787118909.100462:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787118909.100531:0:14437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14437:1873929566271488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787118909.100629:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118909.100663:0:14437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9613452b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787118909.100765:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566271488 00000100:00100000:0.0:1787118909.100770:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566271488 00000100:00100000:0.0:1787118909.100800:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787118909.100807:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14437:x1873929566271488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787118909.100872:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14437:x1873929566271488:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118909.100878:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787118909.101522:0:14437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14437:1873929566271488:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787118909.102210:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787118909.102283:0:14437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14437:1873929566271616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787118909.102341:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787118909.102372:0:14437:0:(client.c:2702:ptlrpc_set_wait()) set ffff961354481240 going to sleep for 11 seconds 00000100:00100000:1.0:1787118909.102786:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566271616 00000100:00100000:1.0:1787118909.102792:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566271616 00000100:00100000:1.0:1787118909.102826:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787118909.102834:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14437:x1873929566271616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787118909.102990:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14437:x1873929566271616:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (649us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787118909.102998:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787118909.103456:0:14437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137f73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14437:1873929566271616:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787118909.103491:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103501:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103509:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103515:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118909.103520:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103527:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103541:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:2.0:1787118909.103545:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118909.103557:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103563:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9000/0xaa534e3c784f9bed lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103745:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103752:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103757:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103762:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81000 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118909.103765:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103771:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103780:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118909.103782:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787118909.103791:0:14437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103802:0:14437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103810:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.103853:0:14437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987e00/0xaa534e3c784f9b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.10@tcp remote: 0x13724b042ec2be35 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.103866:0:14437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566271744:192.168.203.10@tcp:105: 00000100:00100000:2.0:1787118909.103987:0:14437:0:(client.c:2702:ptlrpc_set_wait()) set ffff96134950ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787118909.109022:0:14437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14437:1873929566271744:192.168.203.10@tcp:105: 00010000:00010000:2.0:1787118909.109062:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109073:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136eb81000/0xaa534e3c784f9b45 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109116:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109129:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109141:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109151:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109166:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109172:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109195:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118909.109199:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109206:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109218:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118909.109221:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787118909.109224:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109230:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96136e987a00/0xaa534e3c784f9bf4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109241:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109247:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109252:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109256:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c8600 already unused, calling callback (ffffffffc1f134f0) 00010000:00010000:2.0:1787118909.109259:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109264:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109280:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96134bc94a00) 00010000:00010000:2.0:1787118909.109282:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787118909.109285:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.109290:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c8600/0xaa534e3c784f9be6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.109547:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:14523:x1873929544266880:12345-192.168.203.10@tcp:57:lhsmtool_posix.0 Request processed in 16501us (17003us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787118909.109557:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 53 00000020:00080000:2.0:1787118909.109562:0:14437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787118909.110297:0:14466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787118909.110303:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787118909.110333:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787118909.110341:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787118909.112652:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.112761:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267264 00000100:00100000:1.0:1787118909.112770:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267264 00000100:00100000:1.0:1787118909.112819:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 10 00000100:00100000:1.0:1787118909.112829:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961241371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:14523:x1873929544267264:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787118909.113489:0:14439:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787118909.113558:0:14439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787118909.113606:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113621:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113632:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113641:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113648:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113655:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787118909.113682:0:14439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787118909.113792:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961241371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:14523:x1873929544267264:12345-192.168.203.10@tcp:35:lhsmtool_posix.0 Request processed in 963us (1147us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787118909.113801:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 10 00000020:00080000:1.0:1787118909.113806:0:14439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787118909.114079:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787118909.114086:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.114094:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96137f6c9600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118909.114098:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.114114:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.114127:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96134bc94000) 00010000:00010000:3.0:1787118909.114130:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787118909.114134:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.114152:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96137f6c9600/0xaa534e3c784f9bfb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.114165:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118909.114167:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787118909.114168:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787118909.115628:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.115700:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267392 00000100:00100000:0.0:1787118909.115708:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267392 00000100:00100000:0.0:1787118909.115785:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:0.0:1787118909.115794:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:14522:x1873929544267392:12345-192.168.203.10@tcp:49:dd.0 00000100:00100000:0.0:1787118909.115905:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96136e2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:14522:x1873929544267392:12345-192.168.203.10@tcp:49:dd.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118909.115913:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 11 00000100:00100000:0.0:1787118909.258533:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787118909.258555:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118909.258624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787118909.260965:0:15123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929566271872 00000100:00100000:3.0:1787118909.260978:0:15123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929566271872 00000100:00100000:3.0:1787118909.261033:0:15123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787118909.261044:0:15123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566271872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787118909.261081:0:15123:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787118909.261294:0:15123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1873929566271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 251us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787118909.261305:0:15123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787118909.263965:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96137abaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1873929566271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787118909.304167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118909.304271:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267520 00000100:00100000:3.0:1787118909.304281:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267520 00000100:00100000:3.0:1787118909.304350:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:3.0:1787118909.304360:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2369:x1873929544267520:12345-192.168.203.10@tcp:4:dd.0 00002000:00010000:3.0:1787118909.304407:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a85453b, atime: 0x6a85453a, ctime: 0x6a85453b, blocks: 0x1 00010000:00010000:3.0:1787118909.304416:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.304437:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787118909.304442:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118909.304448:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.304483:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.323124:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.323401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.323514:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.323620:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787118909.323629:0:15125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787118909.324036:0:15126:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787118909.324051:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267776 00000100:00100000:3.0:1787118909.324060:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267776 00000100:00100000:3.0:1787118909.324121:0:15126:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787118909.324127:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267648 00000100:00100000:3.0:1787118909.324130:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267648 00000100:00100000:3.0:1787118909.324143:0:15126:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787118909.324148:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544267904 00000100:00100000:3.0:1787118909.324150:0:15126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544267904 00000100:00100000:0.0:1787118909.324502:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:0.0:1787118909.324795:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:3.0:1787118909.325087:0:15126:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787118909.326004:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:1.0:1787118909.334415:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268032 00000100:00100000:1.0:1787118909.334429:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268032 00000100:00100000:1.0:1787118909.334504:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787118909.334515:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268160 00000100:00100000:1.0:1787118909.334518:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268160 00000100:00100000:2.0:1787118909.342971:0:16667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:2.0:1787118909.342991:0:16667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:2369:x1873929544267776:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:2.0:1787118909.343036:0:16667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.343053:0:16667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.343058:0:16667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.343064:0:16667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.343077:0:16667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.344770:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787118909.344781:0:15125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787118909.346172:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268288 00000100:00100000:0.0:1787118909.346182:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268288 00000100:00100000:2.0:1787118909.346364:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118909.346391:0:15125:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787118909.346400:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268416 00000100:00100000:2.0:1787118909.346404:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268416 00000100:00100000:0.0:1787118909.359763:0:16668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:0.0:1787118909.359783:0:16668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:2369:x1873929544267648:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:0.0:1787118909.359823:0:16668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.359842:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.359846:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.359853:0:16668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.359868:0:16668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118909.406672:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1787118909.406691:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1787118909.414333:0:15124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787118909.414343:0:15124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787118907 -> 1787118908 00002000:00010000:2.0:1787118909.414346:0:15124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787118907 -> 1787118908 00002000:00010000:2.0:1787118909.414348:0:15124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1787118909.414372:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414385:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414393:0:15124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414400:0:15124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8c000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118909.414406:0:15124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414413:0:15124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414434:0:15124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414460:0:15124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005340e5d8/0xaa534e3c784f9c02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.414549:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:2369:x1873929544267520:12345-192.168.203.10@tcp:4:dd.0 Request processed in 110187us (110397us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787118909.414559:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 0 00000100:00100000:2.0:1787118909.414606:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:2.0:1787118909.414619:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+17:2368:x1873929544267904:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:2.0:1787118909.414654:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414666:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.414670:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.414677:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.414691:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787118909.481121:0:16667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00010000:00010000:0.0:1787118909.481142:0:16667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481155:0:16667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481164:0:16667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481183:0:16667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987a00 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118909.481189:0:16667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481198:0:16667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481216:0:16667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481224:0:16667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae624bf4/0xaa534e3c784f9c09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.481313:0:16667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+19:2369:x1873929544267776:12345-192.168.203.10@tcp:4:dd.0 Request processed in 138324us (158193us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787118909.481323:0:16667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 1 00000100:00100000:0.0:1787118909.481353:0:16667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 4 00000100:00100000:0.0:1787118909.481364:0:16667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+18:2369:x1873929544268032:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:0.0:1787118909.481394:0:16667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481406:0:16667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.481410:0:16667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.481416:0:16667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.481439:0:16667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787118909.481643:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:2.0:1787118909.481713:0:16668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481878:0:16668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481898:0:16668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481905:0:16668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb80600 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:2.0:1787118909.481913:0:16668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481921:0:16668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481934:0:16668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.481941:0:16668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065eaff41/0xaa534e3c784f9c10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787118909.481979:0:16668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:2369:x1873929544267648:12345-192.168.203.10@tcp:4:dd.0 Request processed in 122204us (158772us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787118909.481987:0:16668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 2 00000100:00100000:2.0:1787118909.482004:0:16668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:2.0:1787118909.482012:0:16668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+13:2369:x1873929544268160:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:2.0:1787118909.482030:0:16668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.482039:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.482049:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787118909.482055:0:16668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787118909.482066:0:16668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787118909.557713:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1787118909.566945:0:15124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1787118909.566954:0:15124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787118909.566978:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.566992:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567000:0:15124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567154:0:15124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987400 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118909.567160:0:15124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567169:0:15124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567188:0:15124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567196:0:15124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc006914/0xaa534e3c784f9c17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.567318:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:2368:x1873929544267904:12345-192.168.203.10@tcp:4:dd.0 Request processed in 152698us (243797us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787118909.567327:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 3 00000100:00100000:0.0:1787118909.567366:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 6 00000100:00100000:0.0:1787118909.567378:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:2368:x1873929544268288:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:0.0:1787118909.567415:0:15124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567428:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.567432:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787118909.567438:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.567448:0:15124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.584128:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787118909.622877:0:16667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1787118909.622887:0:16667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1787118909.622902:0:16667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.622916:0:16667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.622945:0:16667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.622952:0:16667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81200 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118909.622957:0:16667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.622967:0:16667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.622995:0:16667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.623010:0:16667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9db9dd3/0xaa534e3c784f9c1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.623094:0:16667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+16:2369:x1873929544268032:12345-192.168.203.10@tcp:4:dd.0 Request processed in 141728us (298587us total) trans 8589934602 rc 0/0 00010000:00010000:3.0:1787118909.623308:0:16668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623318:0:16668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623325:0:16668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623339:0:16668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136e987000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118909.623342:0:16668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623349:0:16668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623373:0:16668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623381:0:16668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576e1583/0xaa534e3c784f9c25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118909.623417:0:16668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+15:2369:x1873929544268160:12345-192.168.203.10@tcp:4:dd.0 Request processed in 141405us (298621us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787118909.623426:0:16668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 5 00000100:00100000:3.0:1787118909.623456:0:16668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 7 00000100:00100000:3.0:1787118909.623467:0:16668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+14:2368:x1873929544268416:12345-192.168.203.10@tcp:4:dd.0 00010000:00010000:3.0:1787118909.623498:0:16668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623511:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118909.623515:0:16668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787118909.623520:0:16668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.623532:0:16668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.624028:0:16667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 4 00000001:00080000:1.0:1787118909.624427:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1787118909.624442:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:3.0:1787118909.667533:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1787118909.669127:0:15124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1787118909.669135:0:15124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1787118909.669150:0:15124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669173:0:15124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669191:0:15124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669199:0:15124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96136eb81000 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:0.0:1787118909.669204:0:15124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669212:0:15124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669230:0:15124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787118909.669238:0:15124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7351ae3/0xaa534e3c784f9c2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787118909.669322:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+9:2368:x1873929544268288:12345-192.168.203.10@tcp:4:dd.0 Request processed in 101943us (343317us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787118909.669331:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 6 00010000:00010000:3.0:1787118909.705286:0:16668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705320:0:16668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705328:0:16668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705337:0:16668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961350e8d800 already unused, calling callback (ffffffffc14f0010) 00010000:00010000:3.0:1787118909.705342:0:16668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705351:0:16668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705369:0:16668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787118909.705377:0:16668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee615e5/0xaa534e3c784f9c33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787118909.705518:0:16668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137abaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+7:2368:x1873929544268416:12345-192.168.203.10@tcp:4:dd.0 Request processed in 82049us (359153us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787118909.705529:0:16668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 7 00000001:00080000:2.0:1787118909.705659:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1787118910.602319:0:14424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787118910.692293:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692373:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692401:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692421:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692450:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.692477:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544269056 00000100:00100000:2.0:1787118910.692486:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544269056 00000100:00100000:2.0:1787118910.692540:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268672 00000100:00100000:2.0:1787118910.692543:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268672 00000100:00100000:2.0:1787118910.692565:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:2.0:1787118910.692575:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2369:x1873929544269056:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.692649:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+6:2369:x1873929544269056:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.692657:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 28 00000100:00100000:2.0:1787118910.692692:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:2.0:1787118910.692699:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:2369:x1873929544268672:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.692759:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+20:2369:x1873929544268672:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.692781:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 29 00000100:00100000:2.0:1787118910.692802:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268800 00000100:00100000:2.0:1787118910.692805:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268800 00000100:00100000:2.0:1787118910.692824:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544269312 00000100:00100000:2.0:1787118910.692827:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544269312 00000100:00100000:2.0:1787118910.692849:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268928 00000100:00100000:2.0:1787118910.692852:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268928 00000100:00100000:2.0:1787118910.692867:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118910.692874:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544268800:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.692900:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544268800:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.692907:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 18 00000100:00100000:2.0:1787118910.692920:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118910.692925:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544269312:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.692946:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544269312:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.692952:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 19 00000100:00100000:2.0:1787118910.692962:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00100000:2.0:1787118910.692968:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544268928:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.692989:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9613476cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ebfb404-33ae-4822-8fe6-8d76ee4076d4+5:2369:x1873929544268928:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 21us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.692995:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 20 00000100:00080000:2.0:1787118910.693012:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787118910.693016:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787118910.693019:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787118910.693171:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544268544 00000100:00100000:0.0:1787118910.693176:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544268544 00000100:00100000:0.0:1787118910.693214:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:0.0:1787118910.693222:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961346578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2369:x1873929544268544:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:0.0:1787118910.693254:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961346578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a8e9cef-a94a-40b4-b113-4311317b3988+13:2369:x1873929544268544:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 33us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787118910.693270:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 121 00000100:00100000:0.0:1787118910.701946:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.10@tcp (source: 12345-192.168.203.10@tcp) 00000100:00100000:2.0:1787118910.702649:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873929544269184 00000100:00100000:2.0:1787118910.702659:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873929544269184 00000100:00100000:2.0:1787118910.702807:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00100000:2.0:1787118910.702819:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544269184:12345-192.168.203.10@tcp:400:kworker.0 00000100:00100000:2.0:1787118910.702895:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96137f726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6e5e66e-017b-467b-b68a-c042fe6d629f+5:2369:x1873929544269184:12345-192.168.203.10@tcp:400:kworker.0 Request processed in 78us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787118910.702901:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.10@tcp, seq: 21 00000100:00080000:3.0:1787118910.707986:0:14431:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787118911.609588:0:16705:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787118911.625894:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787118912.650472:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29911 lines, 29911 kept, 0 dropped, 0 bad.